-- Logs begin at Mon 2022-08-01 14:35:55 UTC, end at Mon 2022-08-01 15:40:40 UTC. -- Aug 01 15:14:48.693371 dv-cinder-847132-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:14:48.702906 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:14:48 2022] *** Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: nodename: dv-cinder-847132-3-iscsi Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: machine: x86_64 Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: clock source: unix Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: pcre jit disabled Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: detected number of CPU cores: 4 Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: current working directory: / Aug 01 15:14:48.704886 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:14:48.705604 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: your processes number limit is 47680 Aug 01 15:14:48.705604 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: your memory page size is 4096 bytes Aug 01 15:14:48.705604 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: detected max file descriptor number: 2048 Aug 01 15:14:48.705604 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: lock engine: pthread robust mutexes Aug 01 15:14:48.705604 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: thunder lock: enabled Aug 01 15:14:48.705604 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:14:48.705604 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:14:48.744102 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: Python main interpreter initialized at 0x564cb545d9c0 Aug 01 15:14:48.744102 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: python threads support enabled Aug 01 15:14:48.744102 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: your server socket listen backlog is limited to 100 connections Aug 01 15:14:48.744102 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:14:48.744471 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:14:48.744563 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: *** Operational MODE: preforking *** Aug 01 15:14:48.744777 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:14:48.744777 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: spawned uWSGI master process (pid: 103299) Aug 01 15:14:48.744999 dv-cinder-847132-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:14:48.745513 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: spawned uWSGI worker 1 (pid: 103300, cores: 1) Aug 01 15:14:48.745872 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: spawned uWSGI worker 2 (pid: 103301, cores: 1) Aug 01 15:14:48.746156 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:14:49.408839 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:14:49.409490 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:14:50.493497 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:14:50.493497 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: from cryptography.utils import int_from_bytes Aug 01 15:14:50.494284 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:14:50.494284 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: from cryptography.utils import int_from_bytes Aug 01 15:14:50.496386 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:14:50.496386 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: from cryptography.utils import int_from_bytes Aug 01 15:14:50.496862 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:14:50.496862 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: from cryptography.utils import int_from_bytes Aug 01 15:14:52.972716 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:14:52.973421 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:14:52.973498 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:14:52.973956 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:14:52.974030 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:14:52.974096 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:14:52.974162 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:14:52.974226 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:14:52.974424 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:14:52.974516 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.974682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:14:52.974812 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.975074 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.975220 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.975367 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.975461 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.975703 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.975844 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.975988 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.976093 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.976321 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.976463 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.976639 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.976768 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.977266 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.977395 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.977481 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.977559 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.977818 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.977947 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.978157 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-3-iscsi {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.978337 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.978452 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.978555 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.978785 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.978993 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-3-iscsi {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.979136 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.979262 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.979391 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.979518 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.979638 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.979767 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.979991 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.980168 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.980314 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.980440 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.980560 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.980775 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.980971 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.981977 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.982114 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.982267 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.982401 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.982537 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.982659 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.982778 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.982904 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.983038 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.983166 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.983287 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.983511 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.983642 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.983763 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.983882 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.984011 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.984208 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.984384 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.984585 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.984760 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.984886 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-3-iscsi {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.985028 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.985240 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-3-iscsi {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.985374 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.985504 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.985630 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.985953 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.986129 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.986306 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.986439 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.986672 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.986860 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.987005 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.987139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.987275 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.987489 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.987668 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.987813 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.987951 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.988083 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.988206 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.988424 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.988602 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.988754 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.988883 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.989031 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.989160 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.989388 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.989581 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.989725 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.989910 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.990036 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.990157 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.990277 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.990397 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.990603 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.990780 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.990915 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.991039 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.991161 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.991300 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.991432 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.991566 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.991687 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.991806 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.992030 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.992227 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.992370 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.992498 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.992626 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.992748 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.992868 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.993006 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.993140 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.993263 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.993384 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.993512 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.993718 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.993926 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994080 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994220 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994351 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994489 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994611 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994730 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994849 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.994968 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.995170 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.995306 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.995458 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.995584 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.995770 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.995896 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.996081 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.996217 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.996351 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.996471 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.996685 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.996811 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.996992 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.997129 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.997309 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.997449 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.997625 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.997751 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.997933 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.998067 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.998251 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.998377 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.998583 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.998708 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.998892 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.999025 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.999229 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.999358 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.999545 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:52.999704 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000003 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000136 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000258 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000425 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000562 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000683 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000816 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.000982 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.001103 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.001222 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.001343 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.001463 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.001673 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.001840 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.001993 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.002119 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.002305 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.002447 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.002579 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.002708 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.002835 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.002957 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.003139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.003274 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.003458 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.003585 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.003762 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.003895 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.004023 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.004151 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.004341 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.004467 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.004645 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.004771 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.004946 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.005081 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.005250 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.005376 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.005548 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.005674 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.005845 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.005979 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.006158 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.006285 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.006452 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.006573 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.006732 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.006858 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.007044 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.007170 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.007352 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.007481 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.007662 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.007787 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.007960 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.008086 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.008260 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.008396 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.008526 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.008751 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.008879 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.009155 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.009300 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.009423 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.009548 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.009753 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.009926 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.010048 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.010168 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.010369 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.010503 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.010686 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.010813 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.010989 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.011126 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.011300 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.011440 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.011610 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.011744 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.011873 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.011998 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.012187 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.012322 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.012505 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.012633 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.012804 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.012931 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.013099 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.013232 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.013406 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.013532 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.013690 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.013866 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.014001 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.014124 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.014310 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.014450 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.014692 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.014827 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.015118 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.015313 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.015507 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.015645 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.015756 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.015976 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.016156 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.016283 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.016404 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.016523 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.016643 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.016771 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.016904 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.017037 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.017235 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.017370 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.017544 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.017679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.017839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.017962 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.018178 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:14:53.018307 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.018517 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.018663 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.018851 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.018985 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.019190 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.019323 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.019526 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.019643 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.019823 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.019920 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.020137 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.020241 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.020464 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.020563 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.020775 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.020870 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.021083 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.021171 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.021390 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.021488 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.021702 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.021815 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.022041 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.022127 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.022356 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.022445 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.022668 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.022766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.022982 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.023071 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.023297 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.023386 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.023603 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.023691 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.023920 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.024079 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.024218 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.024340 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.024531 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.024657 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.024842 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.024965 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.025169 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.025293 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.025492 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.025617 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.025820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.025960 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.026143 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.026268 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.026466 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.026598 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.026776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.026908 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.027083 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.027208 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.027391 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.027516 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.027701 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.027832 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.028012 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.028150 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.028318 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.028442 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.028632 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.028764 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.028943 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.029067 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.029252 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.029375 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.029565 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.029721 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.029894 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.030027 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.030223 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.030347 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.030534 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.030657 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.030846 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.031000 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.031245 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.031435 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.031607 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.031733 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.031886 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.032011 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.032201 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.032333 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.032513 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.032645 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.032820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.032951 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.033126 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.033249 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.033431 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.033556 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.033735 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.033876 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.034066 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.034202 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.034370 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.034506 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.034675 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.034808 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.034984 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.035116 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.035288 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.035412 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.035609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.035741 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.035908 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.036044 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.036215 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.036338 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.036521 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.036644 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.036826 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.036957 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.037127 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.037251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.037435 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.037558 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.037742 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.037910 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.038066 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.038188 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.038377 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.038499 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.038682 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.038812 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.038984 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.039115 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.039301 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.039423 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.039611 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.039735 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.039909 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.040054 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.040230 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.040437 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.040570 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.040827 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.040959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.041142 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.041452 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.041585 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.041765 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.042020 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.042145 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.042394 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.042571 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.042704 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.043018 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.043142 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.043451 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.043684 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.043808 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.044114 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.044231 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.044425 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.044546 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.044752 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.045070 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.045218 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.045391 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.045516 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.045727 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.045960 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.046121 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.046256 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.046433 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.046566 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.046742 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.046867 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.047049 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.047175 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.047358 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.047486 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.047664 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.047789 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.047970 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.048095 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.048274 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.048399 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.048578 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.048703 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.048883 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.049008 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.049236 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.049366 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.049544 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.049678 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.049874 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.050040 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.050200 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.050366 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.050501 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.050713 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.050837 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.051087 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.051210 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.051390 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.051513 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.051732 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.051857 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.052036 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.052159 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.052379 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.052502 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.052715 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.052840 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.053033 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.053157 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.053356 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.053488 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.053667 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.053824 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.054007 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.054130 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.054315 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.054447 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.054626 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.054755 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.054933 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.055055 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.055242 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.055374 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.055563 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.055685 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.055871 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.055993 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.056189 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.056321 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.056497 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.056620 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.056817 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.056940 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.057121 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.057257 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.057440 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.057561 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.057740 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.057929 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.058070 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.058192 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.058401 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.058534 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.058731 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.058852 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.059043 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.059169 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.059362 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.059484 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.059669 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.059790 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.059977 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.060102 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.060325 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.060460 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.060654 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.060778 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.060965 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.061089 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.061272 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.061416 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.061618 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.061753 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.061953 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.062076 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.062267 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.062399 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.062575 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.062706 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063029 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063175 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063298 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063428 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063549 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063800 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.063926 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.064084 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.064218 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.064413 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.064540 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.064723 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.064852 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.065045 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.065175 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.065356 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.065491 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.065665 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.065862 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.065997 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.066118 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.066298 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.066430 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.066604 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.066727 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.066915 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.067039 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.067226 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.067358 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.067534 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.067657 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.067843 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.067965 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.068149 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.068280 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.068456 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.068585 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.068760 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.068883 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.069063 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.069186 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.069368 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.069490 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.069676 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.069832 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.070001 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.070124 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.070311 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.070436 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.070632 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.070764 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.070941 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.071064 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.071245 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.071372 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.071549 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.071685 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.071856 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.071985 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.072159 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.072291 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.072460 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.072591 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.072760 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.072883 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.073060 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.073184 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.073360 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.073482 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.073662 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.073823 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.074015 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.074138 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.074334 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.074461 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.074654 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.074779 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.074965 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.075095 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.075282 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.075406 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.075587 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.075708 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.075893 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.076022 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.076200 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.076330 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.076506 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.076630 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.076813 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.076944 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.077178 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.077310 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.077486 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.077616 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.077805 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.077945 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.078113 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.078243 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.078422 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.078545 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.078730 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.078863 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.079038 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.079161 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.079344 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.079467 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.079645 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.079855 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.079980 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.080099 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.080232 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.080353 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.080532 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.080834 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.080965 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.081170 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.081407 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.081537 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.081738 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.081881 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.082082 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.082216 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.082401 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.082519 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.082720 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.082845 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.083037 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.083162 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.083367 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.083491 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.083680 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.083821 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.083991 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.084115 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.084297 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.084430 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.084618 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.084732 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.084905 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.085023 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.085207 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.085336 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.085510 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.085632 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.085830 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.085955 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.086135 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.086259 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.086437 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.086557 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.086739 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.086863 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.087037 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.087159 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.087339 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.087478 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.087638 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.087761 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.087941 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.088069 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.088250 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.088381 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.088549 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.088670 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.088857 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.088980 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.089158 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.089291 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.089461 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.089583 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.089764 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.089932 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.090088 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.090210 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.090388 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.090501 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.090688 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.090799 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.091028 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.091154 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.091333 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.091457 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.091671 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.091796 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.091982 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.092113 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.092288 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.092416 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.092612 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.092767 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.092942 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.093065 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.093244 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.093387 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.093533 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.093697 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.093887 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.094042 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.094167 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.094357 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.094489 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.094642 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.094770 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.094948 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.095073 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.095250 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.095383 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.095561 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.095687 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.095870 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.095996 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.096178 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.096484 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.096639 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.096787 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.096906 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.097093 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.097225 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.097393 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.097526 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.097710 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.097919 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.098043 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.098177 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.098333 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.098458 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.098634 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.098765 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.098942 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.099073 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.099245 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.099370 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.099553 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.099677 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.099860 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.099985 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.100161 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.100286 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.100464 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.100586 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.100763 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.100885 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.101050 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.101171 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.101350 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.101481 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.101650 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.101806 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.102290 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.102425 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.102594 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.102719 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.102907 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.103038 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.103211 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.103342 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.103510 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.103642 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.103811 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104013 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104143 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104263 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104390 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104512 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104686 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104823 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.104992 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.105115 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.105309 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.105446 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.105618 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.105743 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.105940 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.106071 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.106241 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.106364 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.106530 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.106651 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.106826 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.106950 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.107125 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.107251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.107425 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.107548 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.107721 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.107843 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.108020 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.108151 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.108370 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.108504 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.108677 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.108809 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.108981 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.109185 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.109322 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.109452 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.109574 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.109694 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.109902 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.110039 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.110248 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.110372 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.110552 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.110677 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.110912 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.111044 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.111216 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.111338 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.111531 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.111661 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.111851 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.111990 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.112161 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.112290 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.112470 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.112593 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.112775 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.112891 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.113076 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.113198 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.113385 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.113518 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.113687 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.113853 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.114023 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.114147 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.114325 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.114448 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.114629 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.114763 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.114929 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.115054 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.115230 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.115358 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.115543 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.115667 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.115848 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.115970 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.116157 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.116290 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.116476 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.116600 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.116778 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.116901 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.117086 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.117222 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.117387 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.117516 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.117692 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.117834 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.118024 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.118159 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.118331 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.118461 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.118635 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.118763 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.118940 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.119072 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.119249 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.119376 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.119553 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.119683 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.119860 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.119986 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.120165 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.120293 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.120488 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.120639 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.120770 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.120893 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.121065 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.121187 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.121368 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.121488 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.121671 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.121859 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.121982 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.122101 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.122292 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.122416 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.122597 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.122729 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.122899 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.123024 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.123200 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.123331 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.123496 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.123640 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.123791 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.123986 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.124301 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.124433 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.124609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.124762 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.125019 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.125215 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.125410 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.125593 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.125728 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.125871 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.125992 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.126114 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.126246 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.126379 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.126534 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.126795 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.126930 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.127112 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.127236 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.127426 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.127544 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.127738 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.127862 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.128046 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.128178 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.128349 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.128519 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.128649 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.128770 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.128972 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.129104 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.129281 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.129404 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.129586 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.129708 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.129910 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.130052 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.130214 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.130309 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.130522 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.130644 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.130821 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.130952 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.131139 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.131269 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.131541 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.131670 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.131847 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.131978 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.132145 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.132433 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.132560 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.132750 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.132953 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.133089 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.133201 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.133370 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.133504 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.133692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.133868 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.134042 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.134166 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.134349 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.134495 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.134664 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.134788 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.134967 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.135102 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.135289 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.135405 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.135611 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.135735 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.135922 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.136055 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.136233 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.136364 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.136533 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.136686 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.136853 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.136977 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.137170 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.137293 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.137478 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.137600 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.137814 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.137940 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.138228 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.138353 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.138549 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.138671 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.138848 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.138970 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.139163 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.139288 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.139487 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.139671 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.139848 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.139983 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.140153 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.140278 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.140462 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.140601 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.140767 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.140891 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.141070 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.141195 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.141392 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.141524 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.141693 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.141845 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.142027 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.142152 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.142338 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.142474 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.142643 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.142768 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.142946 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.143070 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.143268 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.143391 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.143553 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.143677 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.143853 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.143985 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.144174 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.144299 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.144484 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.144608 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.144801 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.144938 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.145120 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.145245 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.145422 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.145539 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.145742 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.145883 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.146071 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.146197 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.146374 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.146499 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.146675 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.146798 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.146974 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.147099 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.147314 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.147444 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.147614 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.147741 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.147932 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.148053 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.148258 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.148380 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.148585 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.148717 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.148894 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.149025 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.149222 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.149346 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.149548 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.149679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.149882 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.150004 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.150191 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.150324 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.150514 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.150645 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.150813 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.150935 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.151115 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.151237 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.151420 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.151542 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.151721 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.151845 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.152020 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.152142 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.152317 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.152441 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.152621 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.152744 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.152921 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.153051 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.153217 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.153339 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.153516 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.153648 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.153856 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.153994 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.154160 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.154291 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.154477 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.154600 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.154780 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.154915 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.155080 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.155242 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.155424 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.155548 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.155724 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.155856 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.156207 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.156379 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.156512 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.156655 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.156825 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.156958 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.157266 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.157426 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.157589 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.157740 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.157958 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.158084 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.158205 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.158616 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.158742 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.159013 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.159389 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.159728 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.159903 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.160050 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.160173 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.160352 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.160477 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.160671 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.160796 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.161001 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.161167 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.161315 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.161439 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.161609 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.161738 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.161949 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.162084 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.162264 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.162397 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.162580 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.162702 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.163156 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.163290 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.163486 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.163608 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.163798 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.163921 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.164109 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.164239 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.164420 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.164543 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.164733 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.164861 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.165042 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.165173 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.165352 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.165474 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.165659 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.165794 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.165993 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.166112 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.166301 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.166432 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.166629 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.166751 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.166948 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.167072 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.167271 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.167394 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.167609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.167732 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.167926 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.168050 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.168239 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.168360 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.168551 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.168683 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.168863 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.168993 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.169222 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.169348 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.169534 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.169657 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.169862 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.169998 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.170176 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.170299 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.170491 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.170613 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.170867 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.171011 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.171180 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.171306 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.171492 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.171618 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.171793 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.171974 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.172150 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.172287 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.172420 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.172583 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.172709 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.172893 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.173025 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.173229 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.173354 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.173507 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.173633 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.173860 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.174021 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.174194 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.174324 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.174519 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.174644 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.174833 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.174958 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.175146 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.175279 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.175463 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.175753 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.176025 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.176158 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.176337 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.176463 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.176669 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.176794 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.176992 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.177130 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.177314 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.177445 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.177626 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.177749 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.177969 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.178107 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.178277 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.178399 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.178585 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.178722 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.178885 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.179008 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.179193 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.179318 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.179496 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.179627 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.179795 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.179918 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.180117 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.180238 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.180421 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.180543 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.180725 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.180852 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.181033 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.181156 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.181338 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.181597 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.181924 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.182052 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.182275 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.182401 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.182591 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.182727 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.182916 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.183038 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.183235 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.183358 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.183543 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.183681 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.183849 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.183967 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.184164 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.184287 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.184470 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.184602 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.184828 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.184953 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.185074 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.185194 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.185374 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.185507 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.185677 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.185829 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.186009 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.186125 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.186323 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.186488 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.186664 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.186787 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.186969 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.187101 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.187276 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.187430 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.187605 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.187729 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.187912 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.188046 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.188218 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.188342 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.188523 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.188647 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.188834 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.188957 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.189138 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.189263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.189440 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.189563 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.189746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.189963 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.190088 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.190208 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.190371 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.190502 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.190674 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.190807 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.190983 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.191100 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.191287 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.191419 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.191587 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.191722 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.191887 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.192010 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.192187 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.192319 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.192495 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.192628 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.192847 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.192971 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.193149 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.193273 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.193451 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.193575 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.193753 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.193893 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.194090 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.194224 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.194399 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.194522 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.194714 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.194836 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.195021 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.195143 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.195331 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.195463 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.195676 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.195797 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.195988 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.196265 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.196567 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.196695 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.196903 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.197027 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.197224 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.197357 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.197561 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.197693 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.197894 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.198019 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.198203 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.198341 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.198507 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.198630 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.198814 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.198945 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.199124 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.199255 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.199433 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.199557 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.199738 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.199860 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.200045 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.200191 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.200352 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.200474 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.200658 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.200780 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.200960 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.201125 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.201266 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.201396 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.201571 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.201694 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.201901 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.202093 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.202346 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.202470 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.202653 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.202777 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.202978 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.203102 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.203255 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.203387 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.203571 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.203704 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.203922 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.204046 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.204243 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.204376 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.204566 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.204699 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.204881 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.205005 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.205196 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.205320 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.205506 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.205639 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.205858 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.205980 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.206155 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.206277 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.206463 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.206629 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.206764 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.206886 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.207073 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.207197 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.207402 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.207528 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.207717 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.207841 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.208020 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.208194 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.208448 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.208572 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.208758 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.208882 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.209074 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.209206 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.209393 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.209517 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.209701 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.209856 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.210052 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.210185 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.210368 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.210490 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.210675 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.210798 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.210985 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.211118 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.211288 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.211404 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.211616 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.211739 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.211953 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.212076 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.212278 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.212401 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.212584 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.212707 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.212889 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.213019 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.213191 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.213314 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.213492 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.213615 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.213821 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.213950 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.214132 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.214256 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.214440 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.214566 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.214741 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.214872 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.215043 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.215168 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.215344 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.215475 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.215646 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.215768 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.215947 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.216077 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.216247 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.216384 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.216550 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.216667 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.216848 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.216977 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.217146 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.217277 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.217446 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.217569 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.217799 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.217937 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.218113 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.218246 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.218417 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.218541 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.218723 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.218849 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.219026 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.219160 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.219342 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.219516 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.219670 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.219807 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.219960 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.220092 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.220222 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.220391 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.220520 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.220644 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.220859 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.220993 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.221178 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.221303 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.221505 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.221640 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.221843 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.221970 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.222172 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.222295 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.222483 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.222623 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.222794 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.222917 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.223115 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.223238 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.223435 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.223567 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.223742 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.223873 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.224047 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.224170 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.224381 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.224507 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.224690 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.224815 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.224997 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.225119 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.225304 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.225437 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.225612 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.225737 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.225945 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.226066 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.226235 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.226362 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.226564 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.226690 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.227189 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.227311 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.227496 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.227626 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.227819 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.227945 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.228136 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.228269 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.228450 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.228566 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.228762 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.228895 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.229070 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.229201 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.229392 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.229515 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.229699 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.229847 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.230036 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.230174 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.230348 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.230472 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.230656 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.230778 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.230966 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.231100 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.231274 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.231397 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.231580 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.231696 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.231901 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.232026 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.232188 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.232312 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.232501 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.232632 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.232825 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.232948 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.233135 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.233304 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.233518 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.233692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.233850 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.234137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.234283 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.234457 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.234633 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.234942 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.235067 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.235190 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.235313 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.235435 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.235592 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.235732 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.235906 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.236031 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.236218 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.236345 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.236524 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:14:53.236658 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:14:53.236782 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:14:53.394530 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO dbcounter [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Registered counter for database nova_api Aug 01 15:14:53.394747 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Registered counter for database nova_api Aug 01 15:14:53.415452 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.416973 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_db.sqlalchemy.engines [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103300) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.422868 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:53.423792 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writer thread running {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:53.480634 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.context [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e398c06-d4e1-4334-b93c-f81bdcc1cfda(cell1) {{(pid=103301) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:14:53.480868 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.context [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e398c06-d4e1-4334-b93c-f81bdcc1cfda(cell1) {{(pid=103300) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:14:53.484750 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_concurrency.lockutils [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103300) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.484914 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.486413 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_concurrency.lockutils [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103300) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.486569 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.487222 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_concurrency.lockutils [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103300) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.487376 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.489239 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_concurrency.lockutils [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103300) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.489377 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.491330 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Registered counter for database nova_cell0 Aug 01 15:14:53.491465 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO dbcounter [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Registered counter for database nova_cell0 Aug 01 15:14:53.497274 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO dbcounter [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Registered counter for database nova_cell1 Aug 01 15:14:53.497474 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Registered counter for database nova_cell1 Aug 01 15:14:53.505692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.508524 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.508829 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_db.sqlalchemy.engines [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103300) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.514058 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writer thread running {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:53.514751 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_db.sqlalchemy.engines [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103300) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.516549 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:53.516893 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:53.661767 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writer thread running {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:53.665208 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO dbcounter [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Registered counter for database nova_cell0 Aug 01 15:14:53.672188 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO dbcounter [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Registered counter for database nova_cell0 Aug 01 15:14:53.681471 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG oslo_db.sqlalchemy.engines [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103300) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.685116 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_db.sqlalchemy.engines [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:14:53.687785 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writer thread running {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:53.692890 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writer thread running {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:14:54.033811 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:14:54.040647 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: WARNING keystonemiddleware.auth_token [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:14:54.041075 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:14:54.048211 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: WARNING keystonemiddleware.auth_token [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:14:54.395390 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:14:54.401374 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: WARNING keystonemiddleware.auth_token [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:14:54.405891 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: WARNING keystonemiddleware.auth_token [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:14:54.406930 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564cb545d9c0 pid: 103301 (default app) Aug 01 15:14:54.409169 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:54.410380 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001901 Aug 01 15:14:54.410793 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Mon Aug 1 15:14:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:54.412094 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: WARNING keystonemiddleware.auth_token [None req-ee92e37d-02f9-422e-9db2-d9c5d6d5669b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:14:54.418015 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564cb545d9c0 pid: 103300 (default app) Aug 01 15:16:12.710067 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:12.711122 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 01 15:16:12.711508 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:12.723658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writing DB stats nova_api:SELECT=3 {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:12.724801 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writing DB stats nova_cell0:SELECT=3 {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:12.725905 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writing DB stats nova_cell1:SELECT=3 {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:12.726920 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:13.673762 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-6df880ea-4b81-4848-a41d-47de4a438c4c admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:13.707223 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-6df880ea-4b81-4848-a41d-47de4a438c4c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.988465 Aug 01 15:16:13.708095 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:16.012205 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:16.013673 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-5895f83a-2644-486e-b0e4-9ea879fa2f42 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001872 Aug 01 15:16:16.014106 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:16.483511 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-db37d06e-d853-4ede-b43a-fd53440c1716 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:16.503465 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:16:16.503465 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: warnings.warn(msg) Aug 01 15:16:16.534476 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-db37d06e-d853-4ede-b43a-fd53440c1716 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513913 Aug 01 15:16:16.535094 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:16:16.550237 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=3 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:16.551286 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell1:SELECT=3 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:16.552297 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell0:SELECT=3 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:16.553621 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:16.766173 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-794b847f-3db3-4670-bc60-a6319963f5ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:16.771025 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:16:16.771025 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Aug 01 15:16:16.838381 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-794b847f-3db3-4670-bc60-a6319963f5ca admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293540 Aug 01 15:16:16.845879 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 15:16:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:19.119123 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-db37d06e-d853-4ede-b43a-fd53440c1716 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:19.120149 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-db37d06e-d853-4ede-b43a-fd53440c1716 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 01 15:16:19.120815 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:16:19.889702 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-a6f17b5b-f5e5-491d-b56a-62845e126e86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "id": "d1", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:19.908821 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:16:19.908821 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Aug 01 15:16:19.929724 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-a6f17b5b-f5e5-491d-b56a-62845e126e86 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.802865 Aug 01 15:16:19.937178 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:16:19.942371 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-56380738-6f2a-4578-a315-3b252a048708 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:19.945171 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:16:19.945171 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: warnings.warn(msg) Aug 01 15:16:19.980563 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-56380738-6f2a-4578-a315-3b252a048708 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041796 Aug 01 15:16:19.981937 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 15:16:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:22.292755 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-a6f17b5b-f5e5-491d-b56a-62845e126e86 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:22.293803 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-a6f17b5b-f5e5-491d-b56a-62845e126e86 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 01 15:16:22.294417 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:22.710466 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-e2294af3-5b67-4fb4-b823-c52001e4d44f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "vcpus": 1}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:22.730381 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-e2294af3-5b67-4fb4-b823-c52001e4d44f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430152 Aug 01 15:16:22.730926 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:16:22.743036 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c5323177-691c-437c-9710-0f596342ef86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:22.767786 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c5323177-691c-437c-9710-0f596342ef86 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028470 Aug 01 15:16:22.768366 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 15:16:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:25.003976 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-e2294af3-5b67-4fb4-b823-c52001e4d44f admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:25.005194 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-e2294af3-5b67-4fb4-b823-c52001e4d44f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 01 15:16:25.005608 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:25.463900 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c564fddd-30b7-4ccf-8c89-617f31f90091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "disk": 10, "vcpus": 2}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:25.493563 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c564fddd-30b7-4ccf-8c89-617f31f90091 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481840 Aug 01 15:16:25.494511 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:16:25.511090 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-4559d176-9e81-4da3-960c-2d4edd8b40e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:25.536439 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-4559d176-9e81-4da3-960c-2d4edd8b40e0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030189 Aug 01 15:16:25.537106 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 15:16:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:27.749418 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c564fddd-30b7-4ccf-8c89-617f31f90091 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:27.750462 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c564fddd-30b7-4ccf-8c89-617f31f90091 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 01 15:16:27.750840 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:28.213157 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-4edf120e-180d-40cd-9c8f-85e03965e21c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:28.238333 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-4edf120e-180d-40cd-9c8f-85e03965e21c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481333 Aug 01 15:16:28.240726 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:16:28.253110 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-62908bb7-f3ad-41a0-b5a6-f349dba91a37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:28.280637 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-62908bb7-f3ad-41a0-b5a6-f349dba91a37 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031471 Aug 01 15:16:28.281235 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 15:16:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:30.548078 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-4edf120e-180d-40cd-9c8f-85e03965e21c admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:30.549213 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-4edf120e-180d-40cd-9c8f-85e03965e21c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Aug 01 15:16:30.549641 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:31.037647 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c2cc2dc1-9622-4fcd-b559-e9259fbdcbad admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:31.070618 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c2cc2dc1-9622-4fcd-b559-e9259fbdcbad admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.513990 Aug 01 15:16:31.071331 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 15:16:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:33.380365 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-4edf120e-180d-40cd-9c8f-85e03965e21c admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:33.381418 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-4edf120e-180d-40cd-9c8f-85e03965e21c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 01 15:16:33.381853 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:33.852513 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-9673be28-4849-4a8f-a4d3-f9bfb7101307 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:33.875742 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-9673be28-4849-4a8f-a4d3-f9bfb7101307 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.487497 Aug 01 15:16:33.876654 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:16:33.890737 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-3ead20e3-444c-4892-85d2-3c8242223f4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:33.921391 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-3ead20e3-444c-4892-85d2-3c8242223f4e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035942 Aug 01 15:16:33.922021 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 15:16:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:36.177525 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-9673be28-4849-4a8f-a4d3-f9bfb7101307 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:36.178609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-9673be28-4849-4a8f-a4d3-f9bfb7101307 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 01 15:16:36.179004 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:36.588891 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-f52b9441-2839-4a5a-be6a-4c2fd9fc1ccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:36.609158 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-f52b9441-2839-4a5a-be6a-4c2fd9fc1ccb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423921 Aug 01 15:16:36.616699 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:16:36.622173 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-b85e93cc-f888-4a3f-9a53-c96cc7b57ec4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:36.654020 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-b85e93cc-f888-4a3f-9a53-c96cc7b57ec4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035898 Aug 01 15:16:36.654694 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 15:16:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:38.839280 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-f52b9441-2839-4a5a-be6a-4c2fd9fc1ccb admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:38.840476 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-f52b9441-2839-4a5a-be6a-4c2fd9fc1ccb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Aug 01 15:16:38.840927 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:39.254094 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c96622df-d716-4f2a-8cc8-aa3e7d72d827 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:39.275103 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c96622df-d716-4f2a-8cc8-aa3e7d72d827 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.427991 Aug 01 15:16:39.275669 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:16:39.288451 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-cf072ea8-c92e-4c06-a6fb-6170a8d9cf70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:39.317552 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-cf072ea8-c92e-4c06-a6fb-6170a8d9cf70 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033322 Aug 01 15:16:39.318176 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 15:16:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:41.623788 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c96622df-d716-4f2a-8cc8-aa3e7d72d827 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:41.625458 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c96622df-d716-4f2a-8cc8-aa3e7d72d827 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002137 Aug 01 15:16:41.630780 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:41 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:42.085500 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-2476be62-8cf0-4672-9d03-1390758e009b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "ram": 8192, "id": "4"}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:42.106371 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-2476be62-8cf0-4672-9d03-1390758e009b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474207 Aug 01 15:16:42.106931 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:16:42.119086 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-6793dfb2-26fb-4240-916c-ed723974b045 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:42.146158 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-6793dfb2-26fb-4240-916c-ed723974b045 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030774 Aug 01 15:16:42.147182 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 15:16:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:44.436001 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-2476be62-8cf0-4672-9d03-1390758e009b admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:44.437247 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-2476be62-8cf0-4672-9d03-1390758e009b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001696 Aug 01 15:16:44.437682 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:44.905758 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-02dd928b-32eb-4b23-b224-1c1f9cdd1cb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:44.929221 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-02dd928b-32eb-4b23-b224-1c1f9cdd1cb0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.485346 Aug 01 15:16:44.929952 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 15:16:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:16:44.942841 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-7cc5f311-5ab6-41e6-bea1-f1cbbdcd9f33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:44.953484 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:44.974069 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-7cc5f311-5ab6-41e6-bea1-f1cbbdcd9f33 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035345 Aug 01 15:16:44.975371 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 15:16:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:05.489636 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-02dd928b-32eb-4b23-b224-1c1f9cdd1cb0 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:05.490698 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-02dd928b-32eb-4b23-b224-1c1f9cdd1cb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 01 15:17:05.491090 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:05.502669 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:05.930278 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-c69f0bfd-8a91-4964-a91a-37313d3d468e admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:05.948929 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-c69f0bfd-8a91-4964-a91a-37313d3d468e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.451218 Aug 01 15:17:05.949467 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 15:17:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:07.089678 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-02dd928b-32eb-4b23-b224-1c1f9cdd1cb0 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:07.091610 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-02dd928b-32eb-4b23-b224-1c1f9cdd1cb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002398 Aug 01 15:17:07.092117 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:07.670825 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-149363a0-c4d2-4815-a67d-44091b622666 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:07.676518 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.wsgi [None req-149363a0-c4d2-4815-a67d-44091b622666 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-149363a0-c4d2-4815-a67d-44091b622666 admin admin] Request method failure captured: Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Accept: application/json Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Accept-Encoding: gzip, deflate Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Connection: keep-alive Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Content-Length: 0 Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Host: 10.222.0.48 Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Openstack-Api-Version: compute 2.90 Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Openstack-System-Scope: None Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: User-Agent: python-novaclient Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Auth-Token: gAAAAABi5-5yf5oyFta0XBeSEH0SwJFF0Maefj_2JNVm65PO0DeiXapSVLMieYBOnOX-W59pJd88Jdi2_Y3Tsg7zohLwWIIBe1K7MmWAvZx6kSNIvxP7FDyJBP3T4P4FjP491EWvhH8dxnOB8jf-JD5MUYwyMO1QLm5RgKWJzYaCkHe-hhZ6sjU Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Domain-Id: None Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Domain-Name: None Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Identity-Status: Confirmed Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Is-Admin-Project: True Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Domain-Id: default Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Domain-Name: Default Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Name: admin Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Role: admin,reader,member Aug 01 15:17:07.679876 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Roles: admin,reader,member Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}] Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant: admin Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant-Name: admin Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User: admin Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Domain-Id: default Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Domain-Name: Default Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Id: 1b4b6acdd88e421a86924fd2c155794f Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Name: admin Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: method: > Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: exception: Flavor 42 could not be found. Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: action_args: {'id': '42'} Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:07.681765 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:07.683241 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.684637 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-149363a0-c4d2-4815-a67d-44091b622666 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103300) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:07.686089 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-149363a0-c4d2-4815-a67d-44091b622666 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.446646 Aug 01 15:17:07.686089 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 15:17:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:17:07.691476 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-3b187202-ee42-4c58-ac79-cc67c09a649d admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:07.695799 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:07.715577 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-3b187202-ee42-4c58-ac79-cc67c09a649d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027694 Aug 01 15:17:07.716136 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 15:17:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:07.726449 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-5f2c9f00-43ed-4b1a-923e-135ab7244265 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:07.750351 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-5f2c9f00-43ed-4b1a-923e-135ab7244265 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027840 Aug 01 15:17:07.750902 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 15:17:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:17:07.760882 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-f4e37e41-7d08-4596-9242-24ab9c8bd4c9 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:07.766882 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.wsgi [None req-f4e37e41-7d08-4596-9242-24ab9c8bd4c9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-f4e37e41-7d08-4596-9242-24ab9c8bd4c9 admin admin] Request method failure captured: Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Accept: application/json Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Accept-Encoding: gzip, deflate Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Connection: keep-alive Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Content-Length: 0 Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Host: 10.222.0.48 Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Openstack-Api-Version: compute 2.90 Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Openstack-System-Scope: None Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: User-Agent: python-novaclient Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Auth-Token: gAAAAABi5-5yf5oyFta0XBeSEH0SwJFF0Maefj_2JNVm65PO0DeiXapSVLMieYBOnOX-W59pJd88Jdi2_Y3Tsg7zohLwWIIBe1K7MmWAvZx6kSNIvxP7FDyJBP3T4P4FjP491EWvhH8dxnOB8jf-JD5MUYwyMO1QLm5RgKWJzYaCkHe-hhZ6sjU Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Domain-Id: None Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Domain-Name: None Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Identity-Status: Confirmed Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Is-Admin-Project: True Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Domain-Id: default Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Domain-Name: Default Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Name: admin Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Role: admin,reader,member Aug 01 15:17:07.770139 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Roles: admin,reader,member Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}] Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant: admin Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant-Name: admin Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User: admin Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Domain-Id: default Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Domain-Name: Default Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Id: 1b4b6acdd88e421a86924fd2c155794f Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Name: admin Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: method: > Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: exception: Flavor 42 could not be found. Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: action_args: {'id': '42'} Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:07.771682 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:07.772692 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:07.774137 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-f4e37e41-7d08-4596-9242-24ab9c8bd4c9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:07.775365 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-f4e37e41-7d08-4596-9242-24ab9c8bd4c9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014567 Aug 01 15:17:07.775365 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 15:17:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:17:08.825434 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-5f2c9f00-43ed-4b1a-923e-135ab7244265 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:08.826473 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-5f2c9f00-43ed-4b1a-923e-135ab7244265 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Aug 01 15:17:08.826870 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:09.398996 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-b2a72dc9-d407-4992-865e-0d4505b800a0 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:09.404867 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.wsgi [None req-b2a72dc9-d407-4992-865e-0d4505b800a0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-b2a72dc9-d407-4992-865e-0d4505b800a0 admin admin] Request method failure captured: Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Accept: application/json Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Accept-Encoding: gzip, deflate Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Connection: keep-alive Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Content-Length: 0 Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Host: 10.222.0.48 Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Openstack-Api-Version: compute 2.90 Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Openstack-System-Scope: None Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: User-Agent: python-novaclient Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Auth-Token: gAAAAABi5-50_mNNzEuKWZNjtO5Sq6DOWaNxBTPisOFStplZRwEh959nybJiKOMQ-_yjgoQq0WVrYfPFfgAppgcWSdF5zNqc_ZX6ZrRT8GSItwuGaYH3aJsfn4r_jbEj8N3m9Bf-6EWlij0HPgoYQef45VoHQv7jlCt6sykXmmZZL_X3pmD19hQ Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Domain-Id: None Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Domain-Name: None Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Identity-Status: Confirmed Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Is-Admin-Project: True Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Domain-Id: default Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Domain-Name: Default Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Name: admin Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Role: admin,reader,member Aug 01 15:17:09.406431 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Roles: admin,reader,member Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}] Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant: admin Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant-Name: admin Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User: admin Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Domain-Id: default Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Domain-Name: Default Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Id: 1b4b6acdd88e421a86924fd2c155794f Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Name: admin Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: method: > Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: exception: Flavor 84 could not be found. Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: action_args: {'id': '84'} Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:09.407839 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:09.408766 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.410251 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-b2a72dc9-d407-4992-865e-0d4505b800a0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:09.411576 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-b2a72dc9-d407-4992-865e-0d4505b800a0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.440807 Aug 01 15:17:09.411576 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 15:17:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:17:09.418970 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-e4ef5c86-b1ea-4bb5-a69a-3b2de13ed3fc admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:09.434338 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-e4ef5c86-b1ea-4bb5-a69a-3b2de13ed3fc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020176 Aug 01 15:17:09.434912 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 15:17:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:09.444775 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c4f56322-2968-43b2-b54b-4f681be83c44 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:09.461532 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c4f56322-2968-43b2-b54b-4f681be83c44 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020199 Aug 01 15:17:09.462271 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 15:17:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:09.475946 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-1ae7ab7f-63da-4622-8b2c-ac4eb75b33e6 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:09.482718 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.wsgi [None req-1ae7ab7f-63da-4622-8b2c-ac4eb75b33e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-1ae7ab7f-63da-4622-8b2c-ac4eb75b33e6 admin admin] Request method failure captured: Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Accept: application/json Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Accept-Encoding: gzip, deflate Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Connection: keep-alive Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Content-Length: 0 Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Host: 10.222.0.48 Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Openstack-Api-Version: compute 2.90 Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Openstack-System-Scope: None Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: User-Agent: python-novaclient Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Auth-Token: gAAAAABi5-50_mNNzEuKWZNjtO5Sq6DOWaNxBTPisOFStplZRwEh959nybJiKOMQ-_yjgoQq0WVrYfPFfgAppgcWSdF5zNqc_ZX6ZrRT8GSItwuGaYH3aJsfn4r_jbEj8N3m9Bf-6EWlij0HPgoYQef45VoHQv7jlCt6sykXmmZZL_X3pmD19hQ Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Domain-Id: None Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Domain-Name: None Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Identity-Status: Confirmed Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Is-Admin-Project: True Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Domain-Id: default Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Domain-Name: Default Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Name: admin Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Role: admin,reader,member Aug 01 15:17:09.484263 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Roles: admin,reader,member Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}] Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant: admin Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant-Name: admin Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User: admin Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Domain-Id: default Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Domain-Name: Default Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Id: 1b4b6acdd88e421a86924fd2c155794f Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Name: admin Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: method: > Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: exception: Flavor 84 could not be found. Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: action_args: {'id': '84'} Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:09.485820 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:09.486679 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:09.487776 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-1ae7ab7f-63da-4622-8b2c-ac4eb75b33e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103300) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:09.489663 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-1ae7ab7f-63da-4622-8b2c-ac4eb75b33e6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015173 Aug 01 15:17:09.489663 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 15:17:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:17:10.511961 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-c4f56322-2968-43b2-b54b-4f681be83c44 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:10.513286 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-c4f56322-2968-43b2-b54b-4f681be83c44 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001830 Aug 01 15:17:10.513840 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:11.094072 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-972b047f-9414-4847-898e-f7186f03c5b5 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.100386 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.wsgi [None req-972b047f-9414-4847-898e-f7186f03c5b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-972b047f-9414-4847-898e-f7186f03c5b5 admin admin] Request method failure captured: Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Accept: application/json Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Accept-Encoding: gzip, deflate Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Connection: keep-alive Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Content-Length: 0 Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Host: 10.222.0.48 Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Openstack-Api-Version: compute 2.90 Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Openstack-System-Scope: None Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: User-Agent: python-novaclient Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Auth-Token: gAAAAABi5-52JOrSF3ooZQpEsbjNRqMfAogSMUehJaCcTadIpnuPpspps3vY0n2Etru65UtMMPJNZwk5tAXJJ6b925u2gg9S15fU9GqXK4ZlBUrQBPTe8cBc43i0UgKSc_Id5xYQyv31y6plLv7JVdWgXVRQ6xhizqRrYNBR4Pk9LE1zOQ2xEqY Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Domain-Id: None Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Domain-Name: None Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Identity-Status: Confirmed Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Is-Admin-Project: True Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Domain-Id: default Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Domain-Name: Default Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Project-Name: admin Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Role: admin,reader,member Aug 01 15:17:11.101916 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Roles: admin,reader,member Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}] Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant: admin Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-Tenant-Name: admin Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User: admin Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Domain-Id: default Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Domain-Name: Default Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Id: 1b4b6acdd88e421a86924fd2c155794f Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: X-User-Name: admin Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: method: > Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: exception: Flavor 451 could not be found. Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: action_args: {'id': '451'} Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:11.103658 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:11.104612 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.105959 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-972b047f-9414-4847-898e-f7186f03c5b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103300) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:11.107254 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-972b047f-9414-4847-898e-f7186f03c5b5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.445269 Aug 01 15:17:11.107254 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 15:17:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:17:11.113106 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-a2ae2c12-2681-492c-8d5c-c8d5878a7537 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.128019 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-a2ae2c12-2681-492c-8d5c-c8d5878a7537 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018604 Aug 01 15:17:11.128543 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 15:17:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:11.140706 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.158651 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023686 Aug 01 15:17:11.159199 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 15:17:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:11.171561 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-8b9690ec-f6d0-4258-8cee-e5b7aeb57375 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.180064 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.wsgi [None req-8b9690ec-f6d0-4258-8cee-e5b7aeb57375 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-8b9690ec-f6d0-4258-8cee-e5b7aeb57375 admin admin] Request method failure captured: Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Accept: application/json Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Accept-Encoding: gzip, deflate Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Connection: keep-alive Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Content-Length: 0 Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Host: 10.222.0.48 Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Openstack-Api-Version: compute 2.90 Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Openstack-System-Scope: None Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: User-Agent: python-novaclient Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Auth-Token: gAAAAABi5-52JOrSF3ooZQpEsbjNRqMfAogSMUehJaCcTadIpnuPpspps3vY0n2Etru65UtMMPJNZwk5tAXJJ6b925u2gg9S15fU9GqXK4ZlBUrQBPTe8cBc43i0UgKSc_Id5xYQyv31y6plLv7JVdWgXVRQ6xhizqRrYNBR4Pk9LE1zOQ2xEqY Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Domain-Id: None Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Domain-Name: None Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Identity-Status: Confirmed Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Is-Admin-Project: True Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Domain-Id: default Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Domain-Name: Default Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Project-Name: admin Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Role: admin,reader,member Aug 01 15:17:11.182609 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Roles: admin,reader,member Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ef3b9d837c2248a7ae12fa99e632e776"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef3b9d837c2248a7ae12fa99e632e776"}]}] Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant: admin Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant-Id: ef3b9d837c2248a7ae12fa99e632e776 Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-Tenant-Name: admin Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User: admin Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Domain-Id: default Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Domain-Name: Default Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Id: 1b4b6acdd88e421a86924fd2c155794f Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: X-User-Name: admin Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: method: > Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: exception: Flavor 451 could not be found. Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: action_args: {'id': '451'} Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:11.184746 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:11.185933 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: ERROR nova.api.openstack.wsgi Aug 01 15:17:11.187261 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-8b9690ec-f6d0-4258-8cee-e5b7aeb57375 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:11.188616 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-8b9690ec-f6d0-4258-8cee-e5b7aeb57375 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.018653 Aug 01 15:17:11.188616 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 15:17:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:17:12.196239 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:12.197319 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 01 15:17:12.197688 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:12.786644 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-ee4b7dcf-05e2-4217-9c2c-203413d1ffbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:12.808289 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-ee4b7dcf-05e2-4217-9c2c-203413d1ffbf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.472678 Aug 01 15:17:12.808848 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 15:17:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:17:13.818102 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:13.819111 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 01 15:17:13.819510 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:14.402922 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-56e4ddef-a17a-4212-89ff-820c096591b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:14.425771 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-56e4ddef-a17a-4212-89ff-820c096591b7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.456939 Aug 01 15:17:14.426271 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 15:17:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:17:15.449761 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:15.450786 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Aug 01 15:17:15.451175 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:16.033132 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-a298c21a-6d23-4718-87a9-63ca6ed3a836 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:16.062413 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-a298c21a-6d23-4718-87a9-63ca6ed3a836 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.475238 Aug 01 15:17:16.063297 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 15:17:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:17:17.077521 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:17.078591 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 01 15:17:17.078992 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:17.647078 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-1e630cbf-fff6-480f-8518-4c3b4e7770df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:17.669977 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-1e630cbf-fff6-480f-8518-4c3b4e7770df admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.450038 Aug 01 15:17:17.670530 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 15:17:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:17:18.683673 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:18.685389 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002470 Aug 01 15:17:18.686071 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:19.253420 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-f40af308-df65-4986-9b96-db6bc848d45d admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:19.274385 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-f40af308-df65-4986-9b96-db6bc848d45d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.446671 Aug 01 15:17:19.275009 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Aug 1 15:17:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:11.701054 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:11.702878 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-bbc34a30-c9c5-4ef8-85be-f7f5e8764eb0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002217 Aug 01 15:18:11.703401 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 15:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:11.717464 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:12.158455 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-eaf6ba0d-ef62-4e81-b909-8bf0326b858f admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.183004 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-eaf6ba0d-ef62-4e81-b909-8bf0326b858f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.472805 Aug 01 15:18:12.183570 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 15:18:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:12.207015 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG dbcounter [-] [103300] Writing DB stats nova_api:SELECT=14 {{(pid=103300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:12.213290 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-2720e063-0a60-4fd5-82ad-fd5cf784ad98 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.226182 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-2720e063-0a60-4fd5-82ad-fd5cf784ad98 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021498 Aug 01 15:18:12.226997 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Aug 1 15:18:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:12.240715 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-d64f5111-166c-4924-8ba2-a4cf7322ca7a admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.248518 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-d64f5111-166c-4924-8ba2-a4cf7322ca7a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011512 Aug 01 15:18:12.249092 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Aug 1 15:18:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:12.262548 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.270525 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013166 Aug 01 15:18:12.271047 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Aug 1 15:18:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:12.282896 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-15ff0395-f5a2-4899-a39a-6bb98440f8c4 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.291214 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-15ff0395-f5a2-4899-a39a-6bb98440f8c4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011942 Aug 01 15:18:12.291936 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Aug 1 15:18:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:41.331549 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:41.332549 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 01 15:21:41.332938 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:41.478353 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=6 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:41.654788 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-141e5682-8f5d-4fe1-bdaa-81a1587133d7 admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:41.657192 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:21:41.657192 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Aug 01 15:21:41.658441 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-141e5682-8f5d-4fe1-bdaa-81a1587133d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.658882 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-141e5682-8f5d-4fe1-bdaa-81a1587133d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.659671 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-141e5682-8f5d-4fe1-bdaa-81a1587133d7 admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.660097 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-141e5682-8f5d-4fe1-bdaa-81a1587133d7 admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.694060 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-141e5682-8f5d-4fe1-bdaa-81a1587133d7 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.217142 Aug 01 15:21:41.694658 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 15:21:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:21:42.537664 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:42.539157 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Aug 01 15:21:42.539717 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:42.744476 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-16c4a679-0b29-4ae7-b83e-afdab0412bde admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:42.747633 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:21:42.747633 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Aug 01 15:21:42.748992 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-16c4a679-0b29-4ae7-b83e-afdab0412bde admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:42.749617 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-16c4a679-0b29-4ae7-b83e-afdab0412bde admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:42.750485 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-16c4a679-0b29-4ae7-b83e-afdab0412bde admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:42.750930 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-16c4a679-0b29-4ae7-b83e-afdab0412bde admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:42.770720 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-16c4a679-0b29-4ae7-b83e-afdab0412bde admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084870 Aug 01 15:21:42.771354 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 15:21:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:21:54.123568 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:54.124911 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001785 Aug 01 15:21:54.125399 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:54.274456 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell0:SELECT=4 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:54.275049 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_cell1:SELECT=4 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:54.275709 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG dbcounter [-] [103301] Writing DB stats nova_api:SELECT=8 {{(pid=103301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:54.337184 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-533a0710-1f36-4cf4-a7ee-6419389715ec admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:54.339686 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:21:54.339686 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Aug 01 15:21:54.340944 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-533a0710-1f36-4cf4-a7ee-6419389715ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:54.341491 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-533a0710-1f36-4cf4-a7ee-6419389715ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:54.342642 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-533a0710-1f36-4cf4-a7ee-6419389715ec admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:54.343062 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-533a0710-1f36-4cf4-a7ee-6419389715ec admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:54.368242 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-533a0710-1f36-4cf4-a7ee-6419389715ec admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.100433 Aug 01 15:21:54.368810 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 15:21:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:21:55.241582 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: DEBUG nova.api.openstack.wsgi [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] Calling method '>' {{(pid=103300) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:55.242708 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: INFO nova.api.openstack.requestlog [None req-fb042ad9-a4e7-4f22-959c-a6ebda215fd8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 01 15:21:55.243112 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: [pid: 103300|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 15:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:55.446745 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG nova.api.openstack.wsgi [None req-2bcd06d0-d029-4f1c-a5e4-e44960c78a5e admin admin] Calling method '>' {{(pid=103301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:55.449140 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:21:55.449140 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: warnings.warn(msg) Aug 01 15:21:55.450362 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-2bcd06d0-d029-4f1c-a5e4-e44960c78a5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.450791 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-2bcd06d0-d029-4f1c-a5e4-e44960c78a5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.451563 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-2bcd06d0-d029-4f1c-a5e4-e44960c78a5e admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.451978 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: DEBUG oslo_concurrency.lockutils [None req-2bcd06d0-d029-4f1c-a5e4-e44960c78a5e admin admin] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.473976 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: INFO nova.api.openstack.requestlog [None req-2bcd06d0-d029-4f1c-a5e4-e44960c78a5e admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083629 Aug 01 15:21:55.474532 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: [pid: 103301|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 15:21:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:22:53.204276 dv-cinder-847132-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 15:22:53.204836 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: Mon Aug 1 15:22:53 2022 - graceful shutdown triggered... Aug 01 15:22:53.205278 dv-cinder-847132-3-iscsi devstack@n-api.service[103301]: Gracefully killing worker 2 (pid: 103301)... Aug 01 15:22:53.206055 dv-cinder-847132-3-iscsi devstack@n-api.service[103300]: Gracefully killing worker 1 (pid: 103300)... Aug 01 15:22:54.205735 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: worker 1 buried after 1 seconds Aug 01 15:22:54.205735 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: worker 2 buried after 1 seconds Aug 01 15:22:54.205735 dv-cinder-847132-3-iscsi devstack@n-api.service[103299]: goodbye to uWSGI. Aug 01 15:22:54.207485 dv-cinder-847132-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 15:22:54.208062 dv-cinder-847132-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 15:22:54.211064 dv-cinder-847132-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:22:54.222988 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:22:54 2022] *** Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: nodename: dv-cinder-847132-3-iscsi Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: machine: x86_64 Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: clock source: unix Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: pcre jit disabled Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: detected number of CPU cores: 4 Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: current working directory: / Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:22:54.224935 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: your processes number limit is 47680 Aug 01 15:22:54.225843 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: your memory page size is 4096 bytes Aug 01 15:22:54.225843 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: detected max file descriptor number: 2048 Aug 01 15:22:54.225843 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: lock engine: pthread robust mutexes Aug 01 15:22:54.225843 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: thunder lock: enabled Aug 01 15:22:54.225843 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:22:54.225843 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:22:54.267568 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: Python main interpreter initialized at 0x55bb67a979c0 Aug 01 15:22:54.267568 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: python threads support enabled Aug 01 15:22:54.267568 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: your server socket listen backlog is limited to 100 connections Aug 01 15:22:54.267568 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:22:54.268072 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:22:54.268072 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: *** Operational MODE: preforking *** Aug 01 15:22:54.268354 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:22:54.268354 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: spawned uWSGI master process (pid: 117803) Aug 01 15:22:54.268610 dv-cinder-847132-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:22:54.269727 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: spawned uWSGI worker 1 (pid: 117824, cores: 1) Aug 01 15:22:54.269727 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: spawned uWSGI worker 2 (pid: 117825, cores: 1) Aug 01 15:22:54.269727 dv-cinder-847132-3-iscsi devstack@n-api.service[117803]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:22:54.935015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:22:54.936107 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:22:56.085460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:56.085460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: from cryptography.utils import int_from_bytes Aug 01 15:22:56.086425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:56.086425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: from cryptography.utils import int_from_bytes Aug 01 15:22:56.087086 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:56.087086 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: from cryptography.utils import int_from_bytes Aug 01 15:22:56.087326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:22:56.087326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: from cryptography.utils import int_from_bytes Aug 01 15:22:58.551589 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:22:58.552176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:22:58.552269 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:22:58.552631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:22:58.552879 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:22:58.553264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.553585 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.553927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.554243 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.554564 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.554873 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.555161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.555500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.555821 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.556049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.556374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.556697 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-3-iscsi {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.557010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.557461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.557790 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.558114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.558558 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.558882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.559196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.559770 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.561237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.561237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.561237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.561237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.561582 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.563881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.563881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.563881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.563881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.564224 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:22:58.564613 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.564700 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:22:58.564785 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-3-iscsi {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.564866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:22:58.564949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.564949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565108 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:22:58.565108 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:22:58.565252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565335 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565860 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.565990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.566105 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.566191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.566272 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.566352 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.566435 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.566516 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.566990 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.567223 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.567460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.567678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.567913 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.568160 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.568383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.568598 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.568816 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-3-iscsi {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.569079 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.569311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.569531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.569531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.569974 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.570191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.570415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.570632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.570847 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.571063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.571283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.571446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.571612 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.571809 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.571965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.572120 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.572120 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.572413 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.572588 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.572743 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.572900 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.573073 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.573226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.573393 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.573548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.573885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.574042 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.574188 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.574332 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.574494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.574653 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.574804 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.574959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.575110 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.575373 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.575524 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.575681 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.575838 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.575992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.575992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.576323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-3-iscsi {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.576476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.576629 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.576782 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.576939 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.577104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.577250 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.577402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.577554 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.577797 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.577955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.577955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.578253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.578253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.578536 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.578692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.578847 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.579006 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.579161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.579314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.579458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.579614 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.579768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.579924 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.580078 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.580231 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.580394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.580394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.580692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.580845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.580999 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.581146 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.581291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.581435 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.581606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.581763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.581998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.582159 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.582306 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.582460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.582606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.582750 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.582900 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.583055 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.583208 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.583368 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.583514 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.583669 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.584050 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.584211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.584364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.584636 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.584800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.584955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.585108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.585256 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.585419 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.585565 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.585757 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.585924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.586081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.586235 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.586397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.586545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.586689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.586841 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.586994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.587146 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.587304 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.587459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.587605 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.587760 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.587906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.588050 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.588205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.588360 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.588514 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.588668 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.588820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.588979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.589125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.589270 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.590259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.590349 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.590439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.590526 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.590610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.590991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591078 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591164 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591238 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591317 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591557 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591703 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591867 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.591949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592037 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592117 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592281 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592360 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592522 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592602 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.592936 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593428 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593661 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593733 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593830 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.593926 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594003 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594235 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594308 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594389 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594543 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594622 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594787 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.594940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.595011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.595083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.595154 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.595234 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.595308 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.595380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.595451 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.596031 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.596168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.596302 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.596416 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.596536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.596648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.596758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.596883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.596883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.597121 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.597241 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.597367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.597479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.597606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.597725 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.597872 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.598094 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.598240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.598362 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.598474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.598938 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.599105 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.599303 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.599463 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.599669 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.599839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.600017 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.600194 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.600351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.600515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.600660 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.600804 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.600993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.601150 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.601304 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.601461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.601613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.601766 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.602479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.602660 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.602808 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.602953 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.603108 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.603253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.603406 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.603567 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.603721 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.603908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.604064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.604209 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.604355 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.604508 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.604653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.604803 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.604957 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.605113 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.605266 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.605421 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.605574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.605727 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.606004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.606197 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.606365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.606365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.606710 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.606856 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:22:58.607000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.607000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.607292 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.607444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.607665 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.607820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.607971 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.608140 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.608368 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.608535 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.608694 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.608927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.609096 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.609253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.609411 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.609570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.609717 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.609717 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.610095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.610239 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.610394 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.610554 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.610707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.610851 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.611003 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.611159 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.611329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.611474 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.611619 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.611762 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.611913 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.612483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.612806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.612968 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.613122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.613122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.613418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.613563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.613722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.613947 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.614102 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.614255 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.614407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.614560 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.614720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.614865 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.615017 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.615161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.615305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.615462 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.615622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.615774 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.615931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.616076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.616270 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.616428 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.616589 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.616741 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.616896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.617042 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.617192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.617352 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.617505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.617649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.617811 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.617981 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.618183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.618441 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.618688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.618841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.618995 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.619140 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.619294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.619439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.619591 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.619745 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.619898 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.620055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.620209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.620504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.620677 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.620825 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.620969 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.621122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.621286 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.621438 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.621591 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.621744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.621926 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.622073 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.622647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.622988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.623150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.623298 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.623441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.623594 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.623749 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.623894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.624039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.624184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.624330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.624488 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.624641 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.624797 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.624941 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.625084 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.625228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.625382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.625534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.625695 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.625872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.626021 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.626165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.626374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.626523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.626676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.626839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.626984 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.627136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.627295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.627450 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.627595 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.627739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.627882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.628036 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.628189 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.628336 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.628480 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.628661 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.628888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.629052 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.629341 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.629500 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.629788 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.629965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.630133 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.630311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.630492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.630650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.630795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.630947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.631112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.631327 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.631499 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.631689 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.631849 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.632002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.632156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.632321 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.632870 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.633239 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.633398 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.633543 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.633701 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.633992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.634146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.634298 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.634443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.634586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.634745 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.634899 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.635052 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.635205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.635350 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.635501 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.635661 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.635818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.636011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.636168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.636453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.636619 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.636773 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.637088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.637278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.637555 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.637765 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.637989 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.638136 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.638281 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.638469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.638703 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.638964 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.639211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.639375 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.639521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.639672 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.639816 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.639969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.640197 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.640344 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.640496 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.640647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.640804 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.640964 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.641109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.641253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.641404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.641549 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.641692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.641867 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.642018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.642169 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.642315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.642459 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.642999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.643205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.643466 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.643704 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.643863 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.644015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.644162 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.644315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.644460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.644611 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.644762 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.644915 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.645069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.645215 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.645372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.645525 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.645684 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.645910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.646075 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.646225 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.646377 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.646571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.646720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.646871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.647031 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.647176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.647321 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.647474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.647712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.647862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.648020 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.648165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.648320 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.648472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.648624 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.648777 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.648930 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.649091 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.649323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.649485 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.649630 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.649801 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.649962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.650114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.650266 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.650411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.650555 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.650712 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.650857 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.650999 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.651149 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.651293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.651453 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.651612 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.651764 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.651919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.652071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.652216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.652515 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.652712 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.653209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.653453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.653705 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.653998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.654161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.654325 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.654470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.654622 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.654773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.654917 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.655144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.655290 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.655434 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.655579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.655732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.655876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.656028 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.656188 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.656362 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.656507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.656694 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.656842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.656996 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.657141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.657292 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.657446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.657591 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.657851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.658004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.658148 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.658299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.658454 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.658605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.658764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.658918 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.659070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.659215 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.659456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.659614 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.659769 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.659915 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.660058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.660210 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.660380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.660525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.660682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.660827 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.660980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.661124 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.661274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.661428 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.661580 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.661732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.661925 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.662089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.662258 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.662432 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.662587 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.662732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.662876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.663401 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.663401 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.663746 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.664011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.664254 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.664403 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.664556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.664700 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.664881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.665079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.665228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.665374 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.665526 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.665700 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.665871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.666030 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.666176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.666454 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.666454 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.666806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.667022 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.667185 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.667345 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.667505 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.667505 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.667799 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.668034 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.668187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.668187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.668486 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.668639 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.668792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.669019 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.669176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.669342 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.669586 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.669745 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.669916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.670072 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.670300 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.670463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.670622 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.670773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.670923 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.671073 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.671224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.671388 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.671552 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.671703 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.671854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.672011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.672176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.672328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.672480 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.672638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.672798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.672949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.673619 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.673839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.674018 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.674298 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.674564 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.674724 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.674895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.675056 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.675208 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.675367 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.675673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.675673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.676000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.676162 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.676312 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.676475 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.676628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.676835 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.676991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.677153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.677313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.677474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.677627 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.677810 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.677968 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.678214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.678383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.678544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.678709 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.678875 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.679040 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.679191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.679353 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.679511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.679767 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.679927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.680087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.680239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.680471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.680632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.680792 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.680962 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.681121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.681281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.681445 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.681445 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.681743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.681921 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.682074 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.682225 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.682392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.682544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.682696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.682847 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.683021 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.683182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.683440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.683871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.684036 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.684198 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.684461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.684788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.684957 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.685112 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.685264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.685422 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.685581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.685769 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.685991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.686144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.686307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.686459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.686609 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.686609 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.686947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.686947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.687242 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.687242 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.687552 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.687722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.687873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.688031 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.688201 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.688423 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.688589 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.688742 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.688929 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.689098 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.689292 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.689533 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.690033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.690201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.690377 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.690538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.690698 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.690859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.691025 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.691184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.691337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.691488 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.691654 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.691816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.691976 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.692128 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.692287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.692458 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.692617 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.692778 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.692931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.693082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.693233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.693405 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.693637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.694135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.694307 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.694489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.694740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.695001 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.695170 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.695333 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.695537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.695771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.695930 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.696089 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.696259 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.696413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.696598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.696764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.696924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.697124 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.697331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.697488 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.697640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.697640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.697967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.698119 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.698280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.698449 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.698693 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.698850 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.699002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.699166 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.699358 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.699559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.699721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.699873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.700174 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.700358 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.700520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.700680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.700840 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.701025 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.701215 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.701407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.701569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.701721 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.701936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.702090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.702252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.702419 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.702579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.702731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.702897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.703056 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.703216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.703380 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.703548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.703814 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.704340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.704526 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.704694 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.705010 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.705281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.705447 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.705599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.705757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.705945 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.706106 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.706265 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.706423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.706583 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.706735 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.706908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.707122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.707278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.707429 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.707580 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.707740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.707900 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.708061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.708214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.708373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.708532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.708710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.708961 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.709127 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.709287 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.709440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.709599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.709766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.709985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.710194 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.710440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.710610 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.710763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.710931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.711091 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.711257 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.711408 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.711559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.711718 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.711879 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.712032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.712190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.712343 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.712494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.712659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.712818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.712969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.713126 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.713288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.713440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.713673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.713862 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.714091 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.714522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.714690 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.714843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.715022 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.715275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.715523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.716019 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.716217 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.716388 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.716551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.716711 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.716863 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.717015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.717213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.717378 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.717378 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.717683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.717890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.718047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.718212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.718390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.721578 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.721808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.721996 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.722166 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.722332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.722332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.722650 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.722806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.722806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.723110 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.723271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.723433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.723667 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.723667 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.723970 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.724214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.724722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.724841 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.724841 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.725071 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.725168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.725272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.725370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.725458 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.725751 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.725925 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726062 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726177 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.726980 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727102 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727617 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727730 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.727954 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728073 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.728881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729007 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729243 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729360 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729599 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729867 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.729995 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730284 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730521 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730780 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730897 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.730897 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.731126 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.731276 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.731434 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.731779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.731905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732032 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732258 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732369 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732508 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732878 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.732999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733358 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733358 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733706 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.733967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.734107 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.734239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.734452 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.734852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.734975 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.735097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.735220 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.735334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.735446 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.735566 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.735704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736139 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736364 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736596 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.736987 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.737218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.737387 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.737507 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.737707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.737862 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.737992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738078 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738226 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738387 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738470 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738619 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738705 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738781 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738781 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.738923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739003 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739303 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739463 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739536 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739670 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739754 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739754 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.739976 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740211 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740487 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740673 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.740896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.741330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.741476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.741621 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.742520 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.742741 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.742953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.743149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.743358 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.743570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.743783 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.743992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.744186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.744378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.745129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.745366 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.745580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.745819 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.746223 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.746536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.746721 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.746926 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.747173 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.747350 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.747568 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.747716 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.747878 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.748052 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.748204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.748378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.748566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.748724 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.748896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.749108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.749287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.749467 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.749637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.749895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.750088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.750257 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.750424 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.750585 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.750759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.750940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.751121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.751296 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.751467 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.751642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.751820 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.752279 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.752494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.752494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.752958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753361 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753488 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753602 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753854 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.753994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.754130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.754245 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.754384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.756446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.756692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.756827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.756955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.756955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.757181 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.757302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.757416 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.757587 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.757726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.757900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.758081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.758245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.758400 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.758566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.758719 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.758877 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.759029 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.759180 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.759330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.759534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.759691 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.759691 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.760041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.760194 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.760353 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.760521 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.760673 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.760673 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.760969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.761120 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.761270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.761468 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.761622 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.761812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.761969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.762138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.762447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.762609 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.762800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.762962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.763121 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.763274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.763438 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.763602 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.763761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.763925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.764114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.764287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.764571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.764571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.764885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.765044 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.765206 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.765371 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.765524 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.765683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.765867 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.766043 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.766600 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.766870 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.767038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.767199 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.767359 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.767519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.767712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.767892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.768054 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.768214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.768376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.768528 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.768701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.768855 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.769014 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.769174 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.769325 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.769485 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.769723 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.769948 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.770102 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.770253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.770403 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.770403 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.770728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.770881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.771033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.771290 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.771447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.771608 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.771771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.771931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.772092 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.772251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.772556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.772725 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.772889 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.773042 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.773241 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.773398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.773564 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.773716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.773892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.774055 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.774208 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.774359 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.774536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.774757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.774922 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.775084 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.775244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.775402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.775562 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.775848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.776020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.776187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.777434 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.777605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.777819 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.777999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.778179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.778408 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.778408 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.778730 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.778893 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.779153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.779340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.779507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.779507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.779805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.779967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.780134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.780308 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.780461 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.780612 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.780762 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.780922 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.781083 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.781243 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.781395 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.781554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.781706 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.781902 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.782074 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.782227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.782757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.782937 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.783140 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.783300 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.783462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.783617 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.783617 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.783912 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.783912 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.784210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.784370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.784523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.784683 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.784950 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.785110 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.785272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.785432 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.785584 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.785737 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.785940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.785940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.786275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.786447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.786936 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.787960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.788143 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.788311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.788479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.788632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.788784 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.788936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.789087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.789248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.789402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.789854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.790167 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.790401 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.790561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.790736 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.790882 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.791161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.791299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.791419 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.791550 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.791716 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.791867 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.791990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792171 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792366 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792562 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792741 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.792961 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793062 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793244 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793332 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793599 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793686 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793796 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.793908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794181 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794377 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794464 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794557 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794838 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.794838 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795024 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795119 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795310 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795404 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795500 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795588 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795681 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795777 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795876 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.795979 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796159 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796354 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796354 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796524 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796893 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.796992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.797161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.797161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.797329 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.797424 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.797511 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.797611 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.797699 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798124 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798215 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798406 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798502 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798589 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798760 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.798760 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799009 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799378 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799657 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.799927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800022 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800110 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800204 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800298 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800557 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800646 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.800924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801218 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801825 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.801916 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802104 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802567 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802662 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.802997 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803085 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803170 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803265 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803354 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803536 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803623 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803708 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803803 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803892 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.803986 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804085 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804373 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804461 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804547 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804899 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.804986 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805078 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805164 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805249 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805344 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805432 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805837 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.805942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806213 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806306 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806392 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.806845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807352 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807787 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.807968 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808272 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808633 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808826 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.808914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809010 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809276 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809567 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.809984 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810141 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810801 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810884 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.810966 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811121 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811202 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811202 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811432 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811579 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811658 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811745 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811828 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.811982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812056 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812134 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812216 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812588 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812672 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812753 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812830 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812902 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.812982 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813141 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813222 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813304 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813566 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813661 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813748 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813865 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.813963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814241 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814337 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814510 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.814948 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815560 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815747 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.815931 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816026 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816408 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816644 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816776 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.816904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.817190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.817319 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.817440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.817562 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.817694 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.817982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.818369 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.818491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.818612 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.818726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.818845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.818973 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819208 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819321 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.819563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.820521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.821373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:22:58.822070 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117824) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:22:58.869998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Registered counter for database nova_api Aug 01 15:22:58.876399 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Registered counter for database nova_api Aug 01 15:22:58.890758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:58.896660 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:58.898538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:58.903628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:58.954104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.context [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e398c06-d4e1-4334-b93c-f81bdcc1cfda(cell1) {{(pid=117825) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:22:58.958084 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.context [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e398c06-d4e1-4334-b93c-f81bdcc1cfda(cell1) {{(pid=117824) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:22:58.958266 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:58.959833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:58.960651 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:58.962174 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:58.962818 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:58.963732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:58.964513 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:58.964788 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Registered counter for database nova_cell0 Aug 01 15:22:58.966973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:58.969040 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Registered counter for database nova_cell0 Aug 01 15:22:58.969201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Registered counter for database nova_cell1 Aug 01 15:22:58.973120 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Registered counter for database nova_cell1 Aug 01 15:22:58.977104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:58.978415 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:58.980170 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:58.984165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:58.986496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:58.986834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:58.990799 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:58.992051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:59.133159 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Registered counter for database nova_cell0 Aug 01 15:22:59.134682 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO dbcounter [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Registered counter for database nova_cell0 Aug 01 15:22:59.140301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:59.141944 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_db.sqlalchemy.engines [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117824) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:22:59.144776 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:59.146306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writer thread running {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:22:59.452195 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:22:59.464145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:22:59.464393 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:22:59.472080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:22:59.811888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:22:59.817927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: WARNING keystonemiddleware.auth_token [None req-11778a97-e574-410f-b2a0-a22fa3ab4851 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:22:59.823245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb67a979c0 pid: 117824 (default app) Aug 01 15:22:59.825596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:22:59.832644 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf885381-986c-46ff-b3d8-a2989c0fca98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:22:59.838068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb67a979c0 pid: 117825 (default app) Aug 01 15:23:42.862274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1d2b9646-f0de-45e4-b3a7-0d136ab3b3cc tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d552a60>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:42.892743 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:42.893804 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:42.894525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:42.895404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:43.710030 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1d2b9646-f0de-45e4-b3a7-0d136ab3b3cc tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/942f416f-457c-4f1c-a338-bf9e7b984581" status: 200 len: 351 microversion: 2.1 time: 1.258663 Aug 01 15:23:43.710631 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:23:42 2022] GET /compute/v2.1/os-volumes/942f416f-457c-4f1c-a338-bf9e7b984581 => generated 351 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:45.880019 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-84a61b28-7933-40f2-87b7-a6304f4817d2 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d551a60>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:45.913973 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.915358 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.916676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:45.918230 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:46.655257 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-84a61b28-7933-40f2-87b7-a6304f4817d2 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/825d25ff-77d7-4f64-a89c-fa40c1f39c89" status: 200 len: 351 microversion: 2.1 time: 1.068996 Aug 01 15:23:46.665909 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:23:45 2022] GET /compute/v2.1/os-volumes/825d25ff-77d7-4f64-a89c-fa40c1f39c89 => generated 351 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:48.336986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-373440a8-0357-430b-abe1-3a20acf6ee14 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d3a7dc0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:48.435967 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-373440a8-0357-430b-abe1-3a20acf6ee14 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b1a405c7-664c-4b3c-9360-e96bda73c5a7" status: 200 len: 351 microversion: 2.1 time: 0.104233 Aug 01 15:23:48.436533 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:23:48 2022] GET /compute/v2.1/os-volumes/b1a405c7-664c-4b3c-9360-e96bda73c5a7 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:48.450287 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-375ef1e1-e256-4ef1-883b-5d368a324922 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d3a7d30>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:48.782103 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-375ef1e1-e256-4ef1-883b-5d368a324922 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.336055 Aug 01 15:23:48.783017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 1 15:23:48 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:48.798198 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a16b8170-42c3-44aa-9e74-4538b5d476f2 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d3a7ca0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:48.991334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a16b8170-42c3-44aa-9e74-4538b5d476f2 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.197069 Aug 01 15:23:48.992075 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Aug 1 15:23:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:49.006180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bfd45355-7ba6-465a-b5f0-095af397fef4 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d2ed9d0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:49.224679 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bfd45355-7ba6-465a-b5f0-095af397fef4 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.222499 Aug 01 15:23:49.225681 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 1 15:23:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:49.240674 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dd635f46-4e7b-41d3-a3bb-93a2e67166cd tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d3a7d30>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:49.407364 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dd635f46-4e7b-41d3-a3bb-93a2e67166cd tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.172050 Aug 01 15:23:49.420438 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Aug 1 15:23:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:49.424985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-add0892f-8ef2-43de-80f1-e46e0060f2e6 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d2edc10>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:49.688045 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-add0892f-8ef2-43de-80f1-e46e0060f2e6 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.266788 Aug 01 15:23:49.689317 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Aug 1 15:23:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:49.704458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-42bfd91f-f3ae-4125-9bfd-b0ab22a65090 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d305040>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:49.927858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-42bfd91f-f3ae-4125-9bfd-b0ab22a65090 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.227163 Aug 01 15:23:49.928426 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 5/9] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 1 15:23:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:49.942678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-595d9832-b927-451b-9092-bb57b9da4085 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d302040>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:50.153484 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-595d9832-b927-451b-9092-bb57b9da4085 tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.215305 Aug 01 15:23:50.154709 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 5/10] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Aug 1 15:23:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:50.169416 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-88be8864-0992-44fb-9ce9-dbf798ebd25d tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] Calling method '.version_select at 0x7f036d30f280>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:50.841752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-88be8864-0992-44fb-9ce9-dbf798ebd25d tempest-VolumesTestJSON-890825992 tempest-VolumesTestJSON-890825992-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.677245 Aug 01 15:23:50.843224 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 6/11] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 1 15:23:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:58.981285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-824517402", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:59.205700 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] validate_networks() for [('433246f6-ca42-465b-a24b-2446665fca6a', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:23:59.610077 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a53f645-8ddd-4077-8245-0d92d0e341c2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'create', calling method: .version_select at 0x7f036d305310>, body: {"keypair": {"name": "tempest-keypair-720865712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENG81I+L5VMh6NcYRbxGK8mH6J8nLkcs+HiT6N4TXvXI5C0miVmeDE25HGfNU3X9TRJt/q1obRRraC3L9ItPyLpZvGDTT7jxSjxRe4pldQ1qyzJMhhaAi/WlK6XSmxn+A=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:59.735447 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-8a53f645-8ddd-4077-8245-0d92d0e341c2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for project 5400c4df102f43398a278247c4431ef6. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:23:59.755233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-8a53f645-8ddd-4077-8245-0d92d0e341c2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for user c60ee64ca18e4930a14e3e17bc979ff7 and project 5400c4df102f43398a278247c4431ef6. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:23:59.887015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a53f645-8ddd-4077-8245-0d92d0e341c2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.809519 Aug 01 15:23:59.888296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 7/12] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 1 15:23:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 811 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 15:24:00.867113 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:00.867641 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:00.868176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:00.868801 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:00.869615 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:00.906081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:00.906081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:00.906747 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:00.909231 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:01.023293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for project a359662d2a444976af8b1b9cc351edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:01.038583 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for user 6f852249c66a4f8986d7a63a957ec91c and project a359662d2a444976af8b1b9cc351edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:01.093624 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:01.097107 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:01.245537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-005bccdc-15dd-4fcc-99d5-76cd8edaf2df tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.547036 Aug 01 15:24:01.246399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 6/13] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:23:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:24:01.265478 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dbb9e81c-59de-4e4e-9490-9e1c63e6341a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:01.270153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dbb9e81c-59de-4e4e-9490-9e1c63e6341a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:01.772780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dbb9e81c-59de-4e4e-9490-9e1c63e6341a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:01.829066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dbb9e81c-59de-4e4e-9490-9e1c63e6341a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1221 microversion: 2.1 time: 0.569428 Aug 01 15:24:01.832128 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 8/14] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:01 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1221 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:02.183487 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-649350076", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:02.283777 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] validate_networks() for [('433246f6-ca42-465b-a24b-2446665fca6a', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:24:03.816735 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1df6a1aa-4499-420b-bea1-d2edf56b0df3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: .version_select at 0x7f036ca34310>, body: {"keypair": {"name": "tempest-keypair-2118309408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/xLexxp0PSXdI2mfT8y7bDgo3uArmZqFxO3wBzDkvYsnDKECoqP1GL/EMcg2Q1ixC6HCu0nAAyoFl9k693IR6l5CRYOzT2DiLFQOuHMrsgbn8FE7lMA1IGNMAtRhIHEQ=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:03.886035 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-1df6a1aa-4499-420b-bea1-d2edf56b0df3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:03.902709 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-1df6a1aa-4499-420b-bea1-d2edf56b0df3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:03.984923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1df6a1aa-4499-420b-bea1-d2edf56b0df3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.416196 Aug 01 15:24:03.984923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 9/15] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:24:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:05.118346 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2118574987", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "networks": [{"uuid": "9271c0a4-4fc7-4719-a8b6-3ada924c0d8d"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:05.298547 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:05.299130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:05.300751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:05.301227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:05.301639 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:05.332891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:05.333512 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:05.338980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:05.353600 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] validate_networks() for [('9271c0a4-4fc7-4719-a8b6-3ada924c0d8d', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:24:05.369390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:05.593758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for project a359662d2a444976af8b1b9cc351edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:05.632683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for user 6f852249c66a4f8986d7a63a957ec91c and project a359662d2a444976af8b1b9cc351edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:05.672889 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:05.679179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:05.782984 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7dd63fb1-1b0e-4b5e-9d35-c33c0dc3bb73 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.604908 Aug 01 15:24:05.783968 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 7/16] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:24:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:24:05.816199 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d92af5d-9c3e-4834-b419-66ff4a44ade4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:05.816820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d92af5d-9c3e-4834-b419-66ff4a44ade4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:06.137395 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5d92af5d-9c3e-4834-b419-66ff4a44ade4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:06.175349 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d92af5d-9c3e-4834-b419-66ff4a44ade4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1221 microversion: 2.1 time: 0.365124 Aug 01 15:24:06.178737 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:05 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1221 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:07.037841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95da6bdd-0b2a-4846-a507-231eace3f1dc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'create', calling method: .version_select at 0x7f036ca24ca0>, body: {"keypair": {"name": "tempest-keypair-1038889112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwsN9R1uXbmKcAfXdjrkf6Txv1Kgdrr/Mabxs5VgEAlXH9PbMTBY0dBGlXG9r6cki/1wuNk1ik7LCMDS94VGac88aLL3XaAm4XV0lzbsznRsojOvqXBtYjFDa3mD79Ndw=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:07.107415 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-95da6bdd-0b2a-4846-a507-231eace3f1dc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:07.175693 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-95da6bdd-0b2a-4846-a507-231eace3f1dc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for user 93d86ae4501e43d59d172d2e7acfdd54 and project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:07.297811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95da6bdd-0b2a-4846-a507-231eace3f1dc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.448232 Aug 01 15:24:07.298447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 9/18] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:24:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:07.304091 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-faabecec-87ed-4f91-88c6-1d68a042726c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:07.312267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-faabecec-87ed-4f91-88c6-1d68a042726c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:07.727189 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-faabecec-87ed-4f91-88c6-1d68a042726c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:07.737877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-faabecec-87ed-4f91-88c6-1d68a042726c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1221 microversion: 2.1 time: 0.438270 Aug 01 15:24:07.738469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 10/19] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:07 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1221 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:08.429011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:08.429626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:08.429927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:08.430521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:08.431135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:08.469478 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:08.482483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:08.484218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:08.489710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:08.675540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Getting quotas for project b13cfc3643554bc785b182b3699058e2. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:08.697240 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Getting quotas for user e6945b8e606f40f1b79bd4aab96a7f1a and project b13cfc3643554bc785b182b3699058e2. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:08.760299 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:08.761016 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:08.777151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:08.781372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:08.783997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:08.790236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:08.796327 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:08.800197 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:09.148805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b9c14b51-20a4-4b7e-bbdc-80f3abc329f7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.161923 Aug 01 15:24:09.152534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 10/20] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:24:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 5167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:24:09.184108 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1399412126", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6ed9b57-cd47-49a1-bf4f-b2ec5a3241c0"}], "security_groups": [{"name": "tempest-securitygroup--1132894711"}], "key_name": "tempest-keypair-720865712", "user_data": "}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:09.550370 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:09.576653 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad442aff-8759-4ece-99e2-ba99dce1b245 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1281 microversion: 2.1 time: 0.821506 Aug 01 15:24:09.577279 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 11/21] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:08 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1281 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:09.621899 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00d4ed0d-8a14-40b7-8893-2b4035372d83 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:09.627855 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00d4ed0d-8a14-40b7-8893-2b4035372d83 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:10.053018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] validate_networks() for [('f6ed9b57-cd47-49a1-bf4f-b2ec5a3241c0', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:24:10.437237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00d4ed0d-8a14-40b7-8893-2b4035372d83 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:10.451701 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00d4ed0d-8a14-40b7-8893-2b4035372d83 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1215 microversion: 2.1 time: 0.859908 Aug 01 15:24:10.454407 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 12/22] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:09 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1215 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:10.645578 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:10.652392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:10.701598 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:10.736307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:10.737298 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:10.737759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:11.068444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:11.078331 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c1fbd6d-25af-4d0c-8e9a-68b204dcfc20 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1279 microversion: 2.1 time: 0.477571 Aug 01 15:24:11.079744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 13/23] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:10 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1279 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:11.479805 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:11.481348 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:11.495967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:11.497487 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:11.499638 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:11.500688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:11.672642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:11.681315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3fada2a7-7b69-4645-8609-4c6b66eab804 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1219 microversion: 2.1 time: 0.206754 Aug 01 15:24:11.686015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 14/24] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:11 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:11.962239 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:11.963452 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:11.964592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:11.965411 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:11.965808 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:11.988161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:11.988607 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:11.990830 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:11.991601 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:12.044049 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for project 5400c4df102f43398a278247c4431ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:12.051666 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for user c60ee64ca18e4930a14e3e17bc979ff7 and project 5400c4df102f43398a278247c4431ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:12.074559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:12.077676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:12.114084 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:12.118395 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:12.146132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:12.149264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:12.151959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:12.154897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:12.258430 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c2f6bcc7-6f64-4e63-a0e0-f152ed5b67e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.103366 Aug 01 15:24:12.273676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 11/25] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 1 15:24:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 3120 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 15:24:12.295505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7fc58224-e588-4972-9321-c59506e7c5b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:12.296376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7fc58224-e588-4972-9321-c59506e7c5b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:12.861634 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7fc58224-e588-4972-9321-c59506e7c5b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:12.871961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7fc58224-e588-4972-9321-c59506e7c5b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:12.879012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7fc58224-e588-4972-9321-c59506e7c5b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:12.884257 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7fc58224-e588-4972-9321-c59506e7c5b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1281 microversion: 2.20 time: 0.607194 Aug 01 15:24:12.886425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 12/26] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:12 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1281 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:12.893128 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:12.899823 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:12.908842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:12.913666 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:12.916616 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:12.920994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d43f143-52bd-4895-900e-546c349e6172 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1279 microversion: 2.1 time: 0.822437 Aug 01 15:24:12.924842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:12 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1279 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:12.931186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:12.932038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:13.286111 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:13.319150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d69758d5-0ad8-44f9-9e5a-d64703358d16 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1219 microversion: 2.1 time: 0.427431 Aug 01 15:24:13.319792 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 13/28] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:12 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1219 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:13.913276 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:13.914853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:13.932551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:13.947438 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:13.948301 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:13.959960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:13.963833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:13.971540 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:13.984439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:13.986246 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:13.994061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:13.994868 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:14.275431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:14.289976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:14.300292 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:14.306785 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61340200-2551-468c-8cad-87af906543a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1285 microversion: 2.20 time: 0.397712 Aug 01 15:24:14.332844 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:14.342361 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 16/29] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:13 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1285 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:24:14.348265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-658c94b5-5db2-4533-bd3e-05bd6333a7a1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1279 microversion: 2.1 time: 0.407297 Aug 01 15:24:14.386351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 14/30] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:13 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1279 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:14.405636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-8647798", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7ed53a-69a3-4296-8374-cca80fe55475"}], "security_groups": [{"name": "tempest-securitygroup--862290744"}], "key_name": "tempest-keypair-2118309408", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:14.418350 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:14.427475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:14.475859 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:14.476650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:14.477488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:14.477994 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:14.742100 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:14.763469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-679f62ec-9c72-4629-a39b-bf2be1d166ce tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1267 microversion: 2.1 time: 0.371332 Aug 01 15:24:14.769183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:14 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1267 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:14.953479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] validate_networks() for [('9b7ed53a-69a3-4296-8374-cca80fe55475', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:24:15.373079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:15.376136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:15.396311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:15.396691 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:15.397482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:15.397951 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:15.477400 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:16.154993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:16.175779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:16.178511 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:16.180004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9e9c6443-b65b-46f0-a620-f932d0fd20ad tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1333 microversion: 2.20 time: 0.813334 Aug 01 15:24:16.180721 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 16/32] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:15 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1333 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:16.188849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:16.192284 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:16.216489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:16.220150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:16.221274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:16.221683 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:16.466057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:16.477204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7479bb19-51a7-4a37-85d5-ee8d429d81f9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1279 microversion: 2.1 time: 0.294559 Aug 01 15:24:16.479350 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:16 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:16.494516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:16.497471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:16.528588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:16.532634 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:16.538678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:16.539894 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:17.567927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:17.589751 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-15839c8f-a9b1-4636-8bde-78de198360d1 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1273 microversion: 2.1 time: 1.108179 Aug 01 15:24:17.594195 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:16 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1273 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:17.600257 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1144298335", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dca719a4-8083-4887-9cb5-1436224f08c6"}], "security_groups": [{"name": "tempest-securitygroup--1860990962"}], "key_name": "tempest-keypair-1038889112", "user_data": "}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:18.505378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:18.506160 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:18.506424 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:18.506871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:18.507365 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:18.524436 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.526559 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.530976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.530976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.591235 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] validate_networks() for [('dca719a4-8083-4887-9cb5-1436224f08c6', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:24:18.594963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:18.606877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:18.640325 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:18.643073 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:18.773094 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9444af4e-5b1a-402d-9cde-e4e22b70193d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.429178 Aug 01 15:24:18.780974 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 17/35] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:24:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 4438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:24:18.793647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:18.794331 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:18.801453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.804297 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.806432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.809671 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:19.314730 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:19.339956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:19.350169 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:19.354178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-15ee1205-63e1-440b-8f1e-ad6f612293bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1339 microversion: 2.20 time: 0.571486 Aug 01 15:24:19.357843 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 18/36] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:18 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1339 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:19.370570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:19.372838 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:19.406083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:19.408054 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:19.410524 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:19.418179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.558184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:20.570198 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82e4004e-6939-4e81-be44-d8be32e7407d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 1.210415 Aug 01 15:24:20.578827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 19/37] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:19 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:20.605514 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:20.607817 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:20.633038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.633885 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.636577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.637307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:21.997254 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:22.016875 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:22.022725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-be8f3dee-4a38-4cb1-8389-8af3c1e22bd3 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 1.433295 Aug 01 15:24:22.024823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:20 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:22.042427 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:22.043866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:22.065951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.070410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.073685 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.074461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.789259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:22.801012 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54a0b62e-00bf-4448-be1a-7ff1cc80aa51 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1297 microversion: 2.1 time: 0.771747 Aug 01 15:24:22.819244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:22 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1297 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:22.840653 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:22.841644 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:22.854953 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.860177 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.868384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.869075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.870744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=24 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:23.447060 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:23.448850 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:23.449545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:23.450175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:23.450775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:23.494238 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.494705 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:23.499927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.500592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:23.578574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:23.596534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for user 93d86ae4501e43d59d172d2e7acfdd54 and project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:23.636330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:23.640966 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:23.818778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1567407-6c0b-4fc8-9f09-bb3c5b8de379 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.222537 Aug 01 15:24:23.830087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 19/40] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:24:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 6234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:24:23.842795 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:23.843608 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:23.907785 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.908249 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:23.909157 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.909640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.039920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:25.050397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:25.051900 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:25.061294 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-556fa543-b9ce-4bcd-9248-de26f9d781cc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 2.230546 Aug 01 15:24:25.062230 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 22/41] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:22 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:25.165376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:25.178438 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-489bb61d-558f-4f58-a10f-d476f3c885de tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 1.344998 Aug 01 15:24:25.179047 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 20/42] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:23 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:25.184192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:25.184803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:25.201964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:25.203560 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.204008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.204801 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.205233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.587928 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-d20d0beb-96a4-43e0-bb6c-87eda7d767ee req-7db1ab0f-5874-4ba6-8968-eb3677ff5293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a6869c6-e9dc-4b39-97c3-9b873bc1deec", "tag": "fbf6bc89-9dd1-4c90-8ddd-84cbd4eff10f"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:25.608090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d20d0beb-96a4-43e0-bb6c-87eda7d767ee req-7db1ab0f-5874-4ba6-8968-eb3677ff5293 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.608548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d20d0beb-96a4-43e0-bb6c-87eda7d767ee req-7db1ab0f-5874-4ba6-8968-eb3677ff5293 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.648513 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-d20d0beb-96a4-43e0-bb6c-87eda7d767ee req-7db1ab0f-5874-4ba6-8968-eb3677ff5293 service nova] Creating event network-changed:fbf6bc89-9dd1-4c90-8ddd-84cbd4eff10f for instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec on hv-cinder-84713 Aug 01 15:24:25.649342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d20d0beb-96a4-43e0-bb6c-87eda7d767ee req-7db1ab0f-5874-4ba6-8968-eb3677ff5293 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117825) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:24:25.651738 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d07785f9-2016-4f16-97fc-ad1672871df3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.653648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d07785f9-2016-4f16-97fc-ad1672871df3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.656853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d07785f9-2016-4f16-97fc-ad1672871df3 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.657315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d07785f9-2016-4f16-97fc-ad1672871df3 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.673161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.compute.rpcapi [None req-d07785f9-2016-4f16-97fc-ad1672871df3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:24:25.674413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d07785f9-2016-4f16-97fc-ad1672871df3 None None] Releasing lock "compute-rpcapi-router" {{(pid=117825) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:24:25.704793 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d07785f9-2016-4f16-97fc-ad1672871df3 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.639878 Aug 01 15:24:25.720226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 23/43] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:25.733497 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:25.735005 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:25.747252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.749358 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.751573 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.752504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.793493 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:25.804117 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8bb3b708-42a3-4477-97f9-cdbdf1e0650f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.624045 Aug 01 15:24:25.817551 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 21/44] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:25 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:25.817551 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:25.817551 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:25.817985 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.818456 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.820337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.820987 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.891722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:25.904215 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50290c3b-bd88-4645-8c2b-3e16e598ec27 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1297 microversion: 2.1 time: 0.181209 Aug 01 15:24:25.904811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 24/45] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:25 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1297 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:25.991230 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:26.005158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b42b1e61-07ba-4c99-b3c6-9ad6aea1daa3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1234 microversion: 2.1 time: 0.198815 Aug 01 15:24:26.006381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 22/46] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:25 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1234 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:26.085430 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:26.087016 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:26.102621 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:26.114083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:26.114601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:26.115820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:26.116260 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:26.201435 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:26.202742 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:26.212955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:26.213415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:26.214572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:26.218527 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.025375 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:27.042298 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-797a9a27-af2a-49b2-8c94-7c5b36cb0e1b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.845485 Aug 01 15:24:27.042888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 23/47] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:26 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:27.065998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:27.081586 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:27.084492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:27.087371 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-64915e74-4e49-4212-8c9c-56f1919da5bb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 1.004896 Aug 01 15:24:27.091232 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 25/48] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:26 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:27.095784 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:27.096774 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:27.102766 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.103242 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.103974 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.104392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.439548 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-fc8466a7-a5d8-4aac-8e2e-469858621636 req-24688762-9fab-4adc-91e9-8edbb6e9e0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735761e9-c26a-4eff-a386-d2d552c6a65f", "tag": "f7f7c786-e86d-4d88-8097-b1c1ab28458d"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:27.478883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fc8466a7-a5d8-4aac-8e2e-469858621636 req-24688762-9fab-4adc-91e9-8edbb6e9e0cf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.480328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fc8466a7-a5d8-4aac-8e2e-469858621636 req-24688762-9fab-4adc-91e9-8edbb6e9e0cf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.547823 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-fc8466a7-a5d8-4aac-8e2e-469858621636 req-24688762-9fab-4adc-91e9-8edbb6e9e0cf service nova] Creating event network-changed:f7f7c786-e86d-4d88-8097-b1c1ab28458d for instance 735761e9-c26a-4eff-a386-d2d552c6a65f on hv-cinder-84713 Aug 01 15:24:27.548739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-fc8466a7-a5d8-4aac-8e2e-469858621636 req-24688762-9fab-4adc-91e9-8edbb6e9e0cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=117824) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:24:27.550186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ae3549-5e22-4737-bedd-5b8dba961b97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.551274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ae3549-5e22-4737-bedd-5b8dba961b97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.552439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ae3549-5e22-4737-bedd-5b8dba961b97 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.553026 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ae3549-5e22-4737-bedd-5b8dba961b97 None None] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.584004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.compute.rpcapi [None req-e7ae3549-5e22-4737-bedd-5b8dba961b97 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:24:27.585576 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e7ae3549-5e22-4737-bedd-5b8dba961b97 None None] Releasing lock "compute-rpcapi-router" {{(pid=117824) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:24:27.659859 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e7ae3549-5e22-4737-bedd-5b8dba961b97 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602448 Aug 01 15:24:27.660581 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 24/49] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:27.668832 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:27.669667 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:27.682570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:27.693731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19907045-4a7a-41a8-bcd2-5be01dc78b47 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.601599 Aug 01 15:24:27.695039 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 26/50] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:27 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:27.700976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:27.702460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:27.702630 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.704314 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.705684 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.705684 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.711672 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.712694 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.714101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.714743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.982799 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:27.997315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-76d4f0ce-98ac-421c-befb-09b26d949313 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1290 microversion: 2.1 time: 0.300850 Aug 01 15:24:27.998241 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 27/51] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:27 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1290 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:28.005340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-88dd5def-bfeb-41bb-8f48-3154480f421c req-ae242674-4a64-4800-a553-6d52d62faa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf39c9-3133-40e5-8942-df02938d1af6", "tag": "fdcf0275-3209-4cb4-8c4b-fe74fbdf8093"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:28.043096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-88dd5def-bfeb-41bb-8f48-3154480f421c req-ae242674-4a64-4800-a553-6d52d62faa17 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.046895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-88dd5def-bfeb-41bb-8f48-3154480f421c req-ae242674-4a64-4800-a553-6d52d62faa17 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.078714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-88dd5def-bfeb-41bb-8f48-3154480f421c req-ae242674-4a64-4800-a553-6d52d62faa17 service nova] Creating event network-changed:fdcf0275-3209-4cb4-8c4b-fe74fbdf8093 for instance 9acf39c9-3133-40e5-8942-df02938d1af6 on hv-cinder-84713 Aug 01 15:24:28.100587 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-88dd5def-bfeb-41bb-8f48-3154480f421c req-ae242674-4a64-4800-a553-6d52d62faa17 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099170 Aug 01 15:24:28.106097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 28/52] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:28.128926 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:28.134678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:28.163726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.164500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.167057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.167844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.246626 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.626814 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=28 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:28.908527 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:28.920465 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-90b946f4-1acb-4ac5-b1b0-52dcf126fe3b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 1.257576 Aug 01 15:24:28.922222 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 25/53] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:27 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:28.934281 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:28.935799 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:28.952857 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.956311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.958881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.960320 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.280688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.294062 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-24010950-09a8-497c-be68-a83d349d084e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 1.182777 Aug 01 15:24:29.294639 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 29/54] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:28 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:29.306741 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:29.307630 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:29.324704 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.325729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.326792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.327446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.608456 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.610915 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=81 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:29.620109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.621633 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.622788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a2fb92ce-f8b5-4618-adb3-345384c1e11a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.697922 Aug 01 15:24:29.628509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 26/55] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:28 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:29.637406 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:29.638050 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:29.651309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.651779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.652580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.653033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.711958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.724278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ac7849d-9e36-4fea-9777-89a4c6ff0baa tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.428414 Aug 01 15:24:29.738301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 30/56] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:29 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:29.744807 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-38b70c2d-b39b-4bbe-80cb-fbe9bab107bb req-10842f17-188a-44fe-af4d-80ebb1bc75e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b57efc3-5810-4f01-9863-c16ab9dba00f", "tag": "1fafaa48-a913-4b85-9a2b-22a5748ea906"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:29.756023 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38b70c2d-b39b-4bbe-80cb-fbe9bab107bb req-10842f17-188a-44fe-af4d-80ebb1bc75e9 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.756742 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38b70c2d-b39b-4bbe-80cb-fbe9bab107bb req-10842f17-188a-44fe-af4d-80ebb1bc75e9 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.770657 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.775449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-38b70c2d-b39b-4bbe-80cb-fbe9bab107bb req-10842f17-188a-44fe-af4d-80ebb1bc75e9 service nova] Creating event network-changed:1fafaa48-a913-4b85-9a2b-22a5748ea906 for instance 7b57efc3-5810-4f01-9863-c16ab9dba00f on hv-cinder-84713 Aug 01 15:24:29.784478 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3aa4392b-dfd4-4015-a43c-572c924377af tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1296 microversion: 2.1 time: 0.154497 Aug 01 15:24:29.786607 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 27/57] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:29 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1296 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:29.794306 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-38b70c2d-b39b-4bbe-80cb-fbe9bab107bb req-10842f17-188a-44fe-af4d-80ebb1bc75e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054209 Aug 01 15:24:29.795814 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 31/58] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:29.949152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:29.950689 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:29.965471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.971134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.973210 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.974078 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:30.326299 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:30.329962 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:30.373055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:30.376537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:30.377758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:30.384442 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.074085 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:31.082336 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98fea858-efaf-45fe-95ed-cf694f185c99 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 1.141775 Aug 01 15:24:31.083168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:29 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:31.087906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:31.088851 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:31.113641 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.114503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.115513 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.116365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.378575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:31.389414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8bb258cc-30fd-4051-b1e8-66bb627ce452 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 1.072278 Aug 01 15:24:31.390332 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 32/60] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:30 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:31.395172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:31.396021 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:31.402684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.403452 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.404438 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.405071 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.936446 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:31.945643 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:31.947726 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:31.948849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c753a48-624e-4981-8843-2fb20dd4c8dc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.864766 Aug 01 15:24:31.962739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:31 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:31.971479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:31.972084 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:31.979079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.979523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.980290 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.980716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.991376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:32.002838 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bb9436ea-93ca-4d5f-9e38-8a5cc4194d46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.610958 Aug 01 15:24:32.003908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 33/62] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:31 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:32.009555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-05c18ca3-02cd-4df2-998e-acb69a1d6115 req-623eb8a7-d523-4929-9283-ce7597359ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762918ff-4812-4e05-be65-d3ab81a9ec32", "tag": "60a932ce-6123-415c-afb5-2c7b47a4a2e7"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:32.022031 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-05c18ca3-02cd-4df2-998e-acb69a1d6115 req-623eb8a7-d523-4929-9283-ce7597359ebe service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.022762 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-05c18ca3-02cd-4df2-998e-acb69a1d6115 req-623eb8a7-d523-4929-9283-ce7597359ebe service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.037683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-05c18ca3-02cd-4df2-998e-acb69a1d6115 req-623eb8a7-d523-4929-9283-ce7597359ebe service nova] Creating event network-changed:60a932ce-6123-415c-afb5-2c7b47a4a2e7 for instance 762918ff-4812-4e05-be65-d3ab81a9ec32 on hv-cinder-84713 Aug 01 15:24:32.043288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-05c18ca3-02cd-4df2-998e-acb69a1d6115 req-623eb8a7-d523-4929-9283-ce7597359ebe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037728 Aug 01 15:24:32.044756 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 34/63] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:32.051792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a4234eb6-ba86-481f-ad56-7ef50812e8ce req-e7d14ce6-bbf5-4611-942d-90a0a7cb549b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061e74c4-3c31-46e4-af02-799b6e731274", "tag": "09d33995-f714-4442-b466-5fcfa7ebc913"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:32.064479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a4234eb6-ba86-481f-ad56-7ef50812e8ce req-e7d14ce6-bbf5-4611-942d-90a0a7cb549b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.065123 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a4234eb6-ba86-481f-ad56-7ef50812e8ce req-e7d14ce6-bbf5-4611-942d-90a0a7cb549b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.082415 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a4234eb6-ba86-481f-ad56-7ef50812e8ce req-e7d14ce6-bbf5-4611-942d-90a0a7cb549b service nova] Creating event network-changed:09d33995-f714-4442-b466-5fcfa7ebc913 for instance 061e74c4-3c31-46e4-af02-799b6e731274 on hv-cinder-84713 Aug 01 15:24:32.089551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a4234eb6-ba86-481f-ad56-7ef50812e8ce req-e7d14ce6-bbf5-4611-942d-90a0a7cb549b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042040 Aug 01 15:24:32.090726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 35/64] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:32.231310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-b7e3334b-ad87-4430-ac08-074f493e96c4 req-e2084d9e-181b-4502-9e84-a708227d15ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf39c9-3133-40e5-8942-df02938d1af6", "name": "network-vif-plugged", "status": "completed", "tag": "fdcf0275-3209-4cb4-8c4b-fe74fbdf8093"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:32.256983 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b7e3334b-ad87-4430-ac08-074f493e96c4 req-e2084d9e-181b-4502-9e84-a708227d15ea service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.258147 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b7e3334b-ad87-4430-ac08-074f493e96c4 req-e2084d9e-181b-4502-9e84-a708227d15ea service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.286627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-b7e3334b-ad87-4430-ac08-074f493e96c4 req-e2084d9e-181b-4502-9e84-a708227d15ea service nova] Creating event network-vif-plugged:fdcf0275-3209-4cb4-8c4b-fe74fbdf8093 for instance 9acf39c9-3133-40e5-8942-df02938d1af6 on hv-cinder-84713 Aug 01 15:24:32.297146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-b7e3334b-ad87-4430-ac08-074f493e96c4 req-e2084d9e-181b-4502-9e84-a708227d15ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204222 Aug 01 15:24:32.298906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 36/65] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:32.311929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:32.314051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:32.333219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.336733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.343182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.357146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.716594 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:32.728524 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f93ccf3b-1d6b-4ee8-a0f2-852ae80f17bd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.763620 Aug 01 15:24:32.729764 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 30/66] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:31 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:32.740583 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:32.743494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:32.751502 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.752078 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.753685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.754225 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.064638 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.076426 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4fa0d25d-1108-4da6-a85d-bfb82f99449c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.772265 Aug 01 15:24:33.077899 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 37/67] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:32 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:33.099419 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:33.100039 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:33.122218 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.122788 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.127030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.127654 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.267429 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.276037 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4aef4175-b29b-4475-b8ee-a2b78bb0bd00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.543857 Aug 01 15:24:33.277330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 31/68] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:32 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:33.283253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:33.284057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:33.293475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.294814 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.296431 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.297224 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.453049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.467975 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.473067 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.477383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-20b4e049-1f2d-4db8-b19e-345bf27f6fe2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.397523 Aug 01 15:24:33.487276 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 38/69] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:33 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:33.511793 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.521798 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-514307ea-f480-4545-adf6-147a0c3cac21 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.243167 Aug 01 15:24:33.522534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 32/70] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:33 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:33.753388 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:33.754561 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:33.762070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.762757 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.764777 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.765220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.925290 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.933139 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a5c96bc-c4a5-4541-9254-8325ff07adaa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.184237 Aug 01 15:24:33.946661 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 39/71] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:33 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:34.102765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:34.103331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:34.105331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:34.110948 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.111328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.112105 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.112545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.299141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:34.299776 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:34.307586 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.308047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.308838 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.309276 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.431515 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:34.440932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6287f3c8-df27-4fd3-a4e5-c6513d3371c1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.341928 Aug 01 15:24:34.453466 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 33/72] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:34 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:34.459141 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-6fd26c8c-c842-4ab8-88c5-6f2fb1fa9fcd req-9ad57019-e5df-4436-b550-eb5df17937ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6869c6-e9dc-4b39-97c3-9b873bc1deec", "name": "network-vif-plugged", "status": "completed", "tag": "fbf6bc89-9dd1-4c90-8ddd-84cbd4eff10f"}, {"server_uuid": "7b57efc3-5810-4f01-9863-c16ab9dba00f", "name": "network-vif-plugged", "status": "completed", "tag": "1fafaa48-a913-4b85-9a2b-22a5748ea906"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:34.471262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6fd26c8c-c842-4ab8-88c5-6f2fb1fa9fcd req-9ad57019-e5df-4436-b550-eb5df17937ba service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.471721 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6fd26c8c-c842-4ab8-88c5-6f2fb1fa9fcd req-9ad57019-e5df-4436-b550-eb5df17937ba service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.485845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-6fd26c8c-c842-4ab8-88c5-6f2fb1fa9fcd req-9ad57019-e5df-4436-b550-eb5df17937ba service nova] Creating event network-vif-plugged:fbf6bc89-9dd1-4c90-8ddd-84cbd4eff10f for instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec on hv-cinder-84713 Aug 01 15:24:34.486660 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-6fd26c8c-c842-4ab8-88c5-6f2fb1fa9fcd req-9ad57019-e5df-4436-b550-eb5df17937ba service nova] Creating event network-vif-plugged:1fafaa48-a913-4b85-9a2b-22a5748ea906 for instance 7b57efc3-5810-4f01-9863-c16ab9dba00f on hv-cinder-84713 Aug 01 15:24:34.493687 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-6fd26c8c-c842-4ab8-88c5-6f2fb1fa9fcd req-9ad57019-e5df-4436-b550-eb5df17937ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044571 Aug 01 15:24:34.494378 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 34/73] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:34.503729 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:34.504765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:34.508913 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:34.512305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.512753 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.513555 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.514047 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.517393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d4fef7f-3fdd-49e9-9fd3-e5b6ef93aa6a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.224191 Aug 01 15:24:34.518088 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 40/74] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:34 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:34.543740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:34.544365 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:34.550808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.551274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.552112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.552546 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.712260 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:34.725631 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:34.731129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:34.732324 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff9bf02d-ee7e-4090-8677-86d6a601a2b0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.233269 Aug 01 15:24:34.732922 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 35/75] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:34 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:34.764418 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:34.773367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6e97ae35-7f8c-47da-88cb-629aafabf8b7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.233769 Aug 01 15:24:34.774227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 41/76] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:34 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:34.956674 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:34.957716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:34.968707 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.969387 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.970350 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.971129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.308404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:35.316372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ab3a37cd-e3a8-485e-acc3-abd64463630b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.365506 Aug 01 15:24:35.316964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 36/77] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:34 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:35.461845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:35.462393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:35.469978 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.470421 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.471196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.471638 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.538770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:35.539565 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:35.546410 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.546949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.550277 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.550277 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.640021 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:35.648156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d52c901e-aaca-4db5-a310-90f70f013e97 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.190344 Aug 01 15:24:35.648729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 42/78] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:35 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:35.731228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:35.739129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e2be3033-ff47-460f-af4b-215eb7606cc8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.204183 Aug 01 15:24:35.740064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 37/79] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:35 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:35.758635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:35.759553 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:35.762530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:35.770328 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.770994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.771789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.772216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.796771 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:35.797891 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:35.806097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.806731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.807946 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:35.808588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.968366 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:35.978232 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:35.980138 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:35.981958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b605e06-52ea-436b-a818-b5e36e58e661 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.229452 Aug 01 15:24:35.982840 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 43/80] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:35 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:36.009365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:36.018204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de83df78-6efe-487e-b16b-09c46fd4361e tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.227015 Aug 01 15:24:36.019525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 38/81] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:35 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:36.338095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:36.339072 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:36.345429 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.345950 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.346733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.347298 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.487422 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:36.495401 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-816651f4-2e82-4aa2-ab04-c8d92a3e967b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.161193 Aug 01 15:24:36.495978 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 44/82] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:36 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:36.669057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:36.669696 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:36.676396 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.676839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.677604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.678065 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.769692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:36.770409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:36.777833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.778516 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.779938 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.780591 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.837420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:36.847014 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7b2dc4dd-43cb-4b83-a8f1-d7a491eec072 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.182068 Aug 01 15:24:36.848396 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 39/83] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:36 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:37.006800 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:37.007424 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:37.015380 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.016708 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.018762 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.019285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.119392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:37.136683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4451a1be-f80f-4aa7-9a1d-39bc90080a5a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.376702 Aug 01 15:24:37.137258 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 45/84] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:36 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:37.153592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:37.154438 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:37.162829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.163314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.164226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.164990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.287016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:37.296605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:37.298520 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:37.300016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a9756ac-ff3c-4a09-a662-bd2a97d5b3d6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.297343 Aug 01 15:24:37.301424 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 40/85] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:37 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:37.365912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:37.367156 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-0ef799e4-4051-4f32-a7fa-b194a8faf58c req-602c0a06-9902-4581-8e5e-512ebd71f41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735761e9-c26a-4eff-a386-d2d552c6a65f", "name": "network-vif-plugged", "status": "completed", "tag": "f7f7c786-e86d-4d88-8097-b1c1ab28458d"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:37.377633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9698158d-0449-4430-bce2-b25ee57da580 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.238273 Aug 01 15:24:37.379531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 46/86] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:37 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:37.379887 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-0ef799e4-4051-4f32-a7fa-b194a8faf58c req-602c0a06-9902-4581-8e5e-512ebd71f41b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.380412 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-0ef799e4-4051-4f32-a7fa-b194a8faf58c req-602c0a06-9902-4581-8e5e-512ebd71f41b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.395472 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-0ef799e4-4051-4f32-a7fa-b194a8faf58c req-602c0a06-9902-4581-8e5e-512ebd71f41b service nova] Creating event network-vif-plugged:f7f7c786-e86d-4d88-8097-b1c1ab28458d for instance 735761e9-c26a-4eff-a386-d2d552c6a65f on hv-cinder-84713 Aug 01 15:24:37.400637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-0ef799e4-4051-4f32-a7fa-b194a8faf58c req-602c0a06-9902-4581-8e5e-512ebd71f41b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038656 Aug 01 15:24:37.401390 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 41/87] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:37.519063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:37.520380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:37.527046 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.527500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.528272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.528703 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.669740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:37.677311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-98083e5f-393a-453e-8c36-edf69668d12c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.162220 Aug 01 15:24:37.677892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 47/88] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:37 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:37.867039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:37.874126 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:37.874815 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:37.881640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.882369 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.883870 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.883965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.026457 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.034919 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1fd2170c-c896-46d9-91b1-d58769fabcbb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.168921 Aug 01 15:24:38.035774 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 42/89] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:37 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:38.158577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:38.159190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:38.165362 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.165844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.166841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.167283 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.310010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.322191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.324773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:38.325392 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:38.332791 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.333451 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.334261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.334680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.347248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2346cd9c-389d-4e33-a4ea-578653ca540d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.192409 Aug 01 15:24:38.360608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 48/90] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:38 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:38.402659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:38.407153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:38.414747 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.415188 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.416155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.416777 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.596902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.606071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.607633 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.609163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-084324a2-c866-429b-b220-ab933358ed09 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.289078 Aug 01 15:24:38.610020 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 43/91] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:38 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:38.646086 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.655239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-83f1b5ab-6e32-4a81-985a-f6917b201cc5 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.258110 Aug 01 15:24:38.655903 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 49/92] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:38 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:38.699615 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:38.700237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:38.707845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.708301 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.709078 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.709718 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.923207 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.925541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.932395 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5376aa41-d492-4c66-8df8-f7d4234702d0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.237798 Aug 01 15:24:38.933040 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 44/93] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:38 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:39.058669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:39.059306 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:39.066081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.066812 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.067754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.068178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.212471 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:39.226187 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-80030406-a6e2-40a4-84df-49301fbc11d1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.172132 Aug 01 15:24:39.238014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 50/94] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:39 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:39.369821 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:39.371000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:39.378125 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.378647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.379469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.379902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.535652 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:39.545153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-09cc7e36-a0e1-4bd1-b2de-50aca3bd6c9b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.179792 Aug 01 15:24:39.545852 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 45/95] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:39 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:39.632787 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:39.633918 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:39.641846 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.642286 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.643237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.643677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.679300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:39.680238 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:39.687185 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.687637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.688415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.688861 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.844708 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:39.855017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:39.856549 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:39.857809 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-30a52722-5bb6-4c5a-922c-d0e3729e616c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.229676 Aug 01 15:24:39.858691 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 51/96] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:39 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:24:39.888176 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:39.895693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c289a65a-ac12-4946-8258-41f29528e3dd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.220426 Aug 01 15:24:39.896265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 46/97] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:39 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:39.965273 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:39.965934 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:39.972680 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.973135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.973959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.974404 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.121935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:40.130976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4594b5c7-ed72-497c-acef-29b702985303 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.170935 Aug 01 15:24:40.131569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 52/98] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:39 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:40.250522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:40.251131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:40.257745 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.258233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.259070 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.259789 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.412865 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:40.421049 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1d48d06e-f3a2-41fb-b3a8-1bdbe12f0296 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.175173 Aug 01 15:24:40.421689 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 47/99] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:40 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:40.566288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:40.567382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:40.587242 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.588086 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.589558 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.590305 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.741715 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:40.749879 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-287e37f9-d0b2-418b-a7eb-cdeaadb19e11 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.188262 Aug 01 15:24:40.750465 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 53/100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:40 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:40.883784 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:40.884399 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:40.892012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.892476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.893286 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.893765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.921271 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:40.921914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:40.947779 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.948641 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.950121 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.950829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:41.465109 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:41.478075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-33fb5fdc-cdf0-4c09-9206-ed52d2d78b81 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.565251 Aug 01 15:24:41.480974 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 54/101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:40 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:41.492562 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:41.493599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:41.510674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:41.511369 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:41.512502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:41.513201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:41.731604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:41.755873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:41.757336 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:41.758588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4c4c82f6-339b-440e-84fa-0821d05acf85 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.880726 Aug 01 15:24:41.759149 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 48/102] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:40 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:41.782462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:41.784914 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:41.797264 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:41.797719 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:41.798537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:41.803613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:41.924093 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:41.945032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-37876643-19cc-4b91-a5d6-e65901fd44d4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.462696 Aug 01 15:24:41.946009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 55/103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:41 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:41.958883 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:41.959503 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:41.975310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:41.975902 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:41.978196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:41.978649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:42.345018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:42.358964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6e3853d4-e896-49c6-85bf-2b104aa2e149 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.598629 Aug 01 15:24:42.359602 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 49/104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:41 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:42.373806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-82838219-17a7-4d5e-8cf7-c8354eeb2e75 req-7cc80e18-6fdb-4e57-b1c8-3e3f078846a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061e74c4-3c31-46e4-af02-799b6e731274", "name": "network-vif-plugged", "status": "completed", "tag": "09d33995-f714-4442-b466-5fcfa7ebc913"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:42.389962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-82838219-17a7-4d5e-8cf7-c8354eeb2e75 req-7cc80e18-6fdb-4e57-b1c8-3e3f078846a4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:42.390710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-82838219-17a7-4d5e-8cf7-c8354eeb2e75 req-7cc80e18-6fdb-4e57-b1c8-3e3f078846a4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:42.411201 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-82838219-17a7-4d5e-8cf7-c8354eeb2e75 req-7cc80e18-6fdb-4e57-b1c8-3e3f078846a4 service nova] Creating event network-vif-plugged:09d33995-f714-4442-b466-5fcfa7ebc913 for instance 061e74c4-3c31-46e4-af02-799b6e731274 on hv-cinder-84713 Aug 01 15:24:42.419594 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-82838219-17a7-4d5e-8cf7-c8354eeb2e75 req-7cc80e18-6fdb-4e57-b1c8-3e3f078846a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053127 Aug 01 15:24:42.426820 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 50/105] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:42.428111 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:42.437849 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c2aad504-ead0-4cef-bde6-b083b78be1fc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1321 microversion: 2.1 time: 0.491093 Aug 01 15:24:42.438869 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 56/106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:41 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:42.502420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:42.503410 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:42.511902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:42.512992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:42.514315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:42.514823 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:42.669123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:42.678082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d3d8f5e6-db8e-4326-ae55-164b854a46e9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.181647 Aug 01 15:24:42.678727 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 51/107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:42 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:42.793817 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:42.794454 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:42.801072 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:42.801571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:42.802539 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:42.802993 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:42.967928 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:42.970165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:42.983777 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:42.984917 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:42.986998 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:42.988116 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.089702 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:43.099244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:43.101134 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:43.103905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c14910b4-40e4-447c-bd11-fcc7898508db tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.315084 Aug 01 15:24:43.119623 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 57/108] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:42 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:43.163437 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:43.174306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-61d46681-2905-4a0f-b245-5ab7272a1b61 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.212702 Aug 01 15:24:43.176885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 52/109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:42 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:43.383994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:43.385763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:43.395979 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.396768 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.398443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.399531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.458993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:43.460171 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:43.468186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.469103 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.470319 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.471026 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.805416 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:43.813931 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10ae4812-1abb-41b8-b321-56ac53739059 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.435811 Aug 01 15:24:43.826753 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 58/110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:43 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:43.834111 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:43.835103 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:43.842244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.843077 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.844081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.844732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.867711 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:43.875732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-53bfcee7-22e8-4313-8b51-54325c3f2f16 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1514 microversion: 2.1 time: 0.420562 Aug 01 15:24:43.877067 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 53/111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:43 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1514 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:43.905582 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:43.917240 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:43.932482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.936754 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:43.938250 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:43.939050 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.049341 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lazy-loading 'flavor' on Instance uuid 735761e9-c26a-4eff-a386-d2d552c6a65f {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:24:44.084161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:44.093883 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e97ce9b-db30-4f57-84fa-92fda391d33f tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.265476 Aug 01 15:24:44.098197 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 59/112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:43 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:44.127537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:44.128425 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:44.137283 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.138052 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.139308 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.140031 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.204034 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-659a87d1-32ef-4163-b387-4f080dbae1d2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f/action" status: 200 len: 32 microversion: 2.1 time: 0.304811 Aug 01 15:24:44.205545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 54/113] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:24:43 2022] POST /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f/action => generated 32 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:24:44.212333 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:44.213131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:44.220909 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.222041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.223279 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.223716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.376937 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:44.389839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:44.391714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:44.392840 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-18b4f9d9-a82f-4e32-b580-64316db2a768 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1407 microversion: 2.20 time: 0.270202 Aug 01 15:24:44.393389 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 60/114] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:44 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:24:44.410142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:44.410844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:44.417698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.418330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.419093 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.419738 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.440892 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:44.452055 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-560da7af-0328-4ee4-b7a0-42ab5f81a5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.244953 Aug 01 15:24:44.452791 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 55/115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:44 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:44.583104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:44.591145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6471522f-3ede-4b97-9806-c7b7cf77e647 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.196509 Aug 01 15:24:44.591714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 61/116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:44 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:44.840951 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:44.841814 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:44.848287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.848858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:44.849491 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:44.850176 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.003836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:45.011664 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1accfa00-9fed-477e-971c-c07b21183e65 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.176506 Aug 01 15:24:45.012231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 56/117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:44 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:45.115159 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:45.118740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:45.126461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.127201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.128051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.128693 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.301508 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:45.328846 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a840d70a-c58d-495e-9ced-6e9f42bc95a7 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.217709 Aug 01 15:24:45.329546 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 62/118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:45 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:45.417751 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:45.419770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:45.432460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.433247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.434300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.435446 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.475366 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:45.476054 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:45.503523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.507980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.509825 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.511455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.698775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:45.707904 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:45.709847 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:45.711251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1a563c9d-a4b4-47ad-913a-1b3fb213c746 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1599 microversion: 2.20 time: 0.299007 Aug 01 15:24:45.712625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 57/119] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:24:45 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1599 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:24:45.735071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:45.735916 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:45.744823 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.745377 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.760450 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.763571 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.828895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:45.841920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd028828-50f5-4b6f-b1b3-b38bb7766e87 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.371843 Aug 01 15:24:45.843939 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 63/120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:45 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:45.850483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-6d798b04-2d39-4520-b667-0a146a425f6e req-462dd7a4-7c5b-4e60-8314-c53a3c3a6edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762918ff-4812-4e05-be65-d3ab81a9ec32", "name": "network-vif-plugged", "status": "completed", "tag": "60a932ce-6123-415c-afb5-2c7b47a4a2e7"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:45.861722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6d798b04-2d39-4520-b667-0a146a425f6e req-462dd7a4-7c5b-4e60-8314-c53a3c3a6edd service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.862531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6d798b04-2d39-4520-b667-0a146a425f6e req-462dd7a4-7c5b-4e60-8314-c53a3c3a6edd service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.879352 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-6d798b04-2d39-4520-b667-0a146a425f6e req-462dd7a4-7c5b-4e60-8314-c53a3c3a6edd service nova] Creating event network-vif-plugged:60a932ce-6123-415c-afb5-2c7b47a4a2e7 for instance 762918ff-4812-4e05-be65-d3ab81a9ec32 on hv-cinder-84713 Aug 01 15:24:45.885068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-6d798b04-2d39-4520-b667-0a146a425f6e req-462dd7a4-7c5b-4e60-8314-c53a3c3a6edd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039272 Aug 01 15:24:45.885926 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 64/121] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:45.892007 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4f43002a-3be3-4142-b2b0-c53da2848cc4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:45.892733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4f43002a-3be3-4142-b2b0-c53da2848cc4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:45.899958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f43002a-3be3-4142-b2b0-c53da2848cc4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.900744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f43002a-3be3-4142-b2b0-c53da2848cc4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:45.901530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f43002a-3be3-4142-b2b0-c53da2848cc4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:45.901991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4f43002a-3be3-4142-b2b0-c53da2848cc4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.105367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4f43002a-3be3-4142-b2b0-c53da2848cc4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.218001 Aug 01 15:24:46.106239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 65/122] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 1 15:24:45 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-interface => generated 284 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:24:46.127650 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:46.128267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:46.146477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.146477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.150291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.150772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.170030 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:46.180232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-436f4fa5-12d5-4073-99c7-e604690c7ff7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.465254 Aug 01 15:24:46.187808 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 58/123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:45 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:46.191172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:46.322077 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:46.330742 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7ad71a96-4c74-41b4-9863-7f69e64c5a14 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.223018 Aug 01 15:24:46.331572 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 66/124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:46 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:46.350306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:46.350919 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:46.372885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.374972 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.378093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.379138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.887214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:46.887863 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:46.901380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.905142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.906196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:46.906521 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:46.909622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:46.925973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dd3915b4-ad45-4671-a414-cfa65a5791b6 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1315 microversion: 2.1 time: 0.574808 Aug 01 15:24:46.927106 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 59/125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:46 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:47.124862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:47.132752 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50922966-cdaf-4042-a16e-821596312539 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.271919 Aug 01 15:24:47.146049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 67/126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:46 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:47.211157 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:47.212173 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:47.219920 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.220684 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.221812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.222414 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.227319 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:47.373928 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:47.378592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:47.394967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.396474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.399166 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.399618 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.661604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:47.670387 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a71e09ae-bc79-4f33-ae36-e529b14de4f4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.463237 Aug 01 15:24:47.672198 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 60/127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:47 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:47.709972 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:47.720477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5b08cd0-90f5-4191-b1cc-f8c7a84e2341 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.361605 Aug 01 15:24:47.735142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 68/128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:47 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:47.951102 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:47.951640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:47.957770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.961753 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:47.965252 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:47.965810 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.157849 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:48.159204 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:48.173089 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.176019 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.179688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.183001 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.260738 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:48.276547 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-52f58361-7ab6-464c-b74a-d28bac53e898 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1502 microversion: 2.1 time: 0.325887 Aug 01 15:24:48.286738 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 61/129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:47 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:48.333664 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-303c2025-d12a-4803-8da6-b0de3a3c2a5c req-bdf036a2-550f-47ed-b9ca-37883d825787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b57efc3-5810-4f01-9863-c16ab9dba00f", "tag": "1fafaa48-a913-4b85-9a2b-22a5748ea906"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:48.348605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-303c2025-d12a-4803-8da6-b0de3a3c2a5c req-bdf036a2-550f-47ed-b9ca-37883d825787 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.349196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-303c2025-d12a-4803-8da6-b0de3a3c2a5c req-bdf036a2-550f-47ed-b9ca-37883d825787 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.364313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-303c2025-d12a-4803-8da6-b0de3a3c2a5c req-bdf036a2-550f-47ed-b9ca-37883d825787 service nova] Creating event network-changed:1fafaa48-a913-4b85-9a2b-22a5748ea906 for instance 7b57efc3-5810-4f01-9863-c16ab9dba00f on hv-cinder-84713 Aug 01 15:24:48.380332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-303c2025-d12a-4803-8da6-b0de3a3c2a5c req-bdf036a2-550f-47ed-b9ca-37883d825787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070050 Aug 01 15:24:48.380332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 62/130] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:48.579025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:48.587695 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0c6b72bf-34a3-4f93-8c94-03f1f7c758a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.436167 Aug 01 15:24:48.592479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 69/131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:48 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:48.696978 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:48.697701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:48.710756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.711373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.712379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.712907 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.746805 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:48.747829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:48.754817 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.755270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:48.756065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:48.756501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:49.172485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:49.181333 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-05765e07-949c-4ac9-b65d-2119c26d58b0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.490343 Aug 01 15:24:49.195846 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 63/132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:48 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:49.202386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:49.211729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c762a6c0-59b4-4cc2-b1e1-95a72a157313 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.468827 Aug 01 15:24:49.212560 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 70/133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:48 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:49.611383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:49.611997 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:49.622257 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:49.622861 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:49.623692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:49.624828 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:49.791932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:49.804018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a875f72-09b1-4169-99ea-05e1ac079db1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.196670 Aug 01 15:24:49.804952 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 64/134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:49 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:50.203258 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:50.203853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:50.211046 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.211856 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.212806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.217511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.237138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:50.237659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:50.244489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.244830 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.245607 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.246064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.446648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:50.454478 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e772575f-ce45-45a3-85bf-fa3a44aa3f18 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.255290 Aug 01 15:24:50.455241 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 71/135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:50 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:50.472415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:50.480209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-83f33ede-6179-4ea4-9bdf-130e7376f1ee tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.247484 Aug 01 15:24:50.480765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 65/136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:50 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:50.827495 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:50.828194 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:50.834880 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.835441 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.836448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:50.836891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:50.980357 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:50.988882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-708f395b-5754-4160-9150-b9cef55af4ef tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.165371 Aug 01 15:24:50.989465 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 72/137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:50 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:51.477103 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:51.477912 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:51.483935 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.484373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.485123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.485541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.500672 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:51.501706 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:51.508188 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.508633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.509391 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:51.509967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:51.693910 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:51.697562 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:51.702566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-00485a22-2e12-43ff-bfa5-932dfc25aa78 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.229605 Aug 01 15:24:51.706130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-24c033fd-7f9b-4c11-bd6b-581e93df5ee4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1364 microversion: 2.1 time: 0.209358 Aug 01 15:24:51.706982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 73/138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:51 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:51.712490 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 66/139] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:51 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:52.011174 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:52.012028 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:52.024047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.024648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.025655 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.038639 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.218831 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:52.227235 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9a911560-161d-409f-947c-56cf01c207b0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.220719 Aug 01 15:24:52.227811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 74/140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:52 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:52.728183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:52.732722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:52.733861 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:52.734993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:52.743135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:52.757573 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.757982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.758485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.759178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.760471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.763639 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:52.764056 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:52.768875 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.175016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:53.183228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4da3f933-699c-441f-a566-d11335a4650f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.461377 Aug 01 15:24:53.183815 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 67/141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:52 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:53.188600 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-54774e85-21d3-4193-92f6-758730958f97 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b527d6b4-26b0-486b-b149-74a121288913"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:53.191580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-54774e85-21d3-4193-92f6-758730958f97 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:53.195203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:53.204410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-973b4fc7-951c-443c-a9d4-e84c86ac5060 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1554 microversion: 2.1 time: 0.478896 Aug 01 15:24:53.205027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 75/142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:52 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1554 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:53.210053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54774e85-21d3-4193-92f6-758730958f97 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.210492 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54774e85-21d3-4193-92f6-758730958f97 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.211306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54774e85-21d3-4193-92f6-758730958f97 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.211727 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54774e85-21d3-4193-92f6-758730958f97 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.226912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82b43fa8-6767-4461-ad8c-563f5701a923 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:53.227490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82b43fa8-6767-4461-ad8c-563f5701a923 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:53.233980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82b43fa8-6767-4461-ad8c-563f5701a923 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.234714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82b43fa8-6767-4461-ad8c-563f5701a923 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.235479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82b43fa8-6767-4461-ad8c-563f5701a923 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.235906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82b43fa8-6767-4461-ad8c-563f5701a923 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.322877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82b43fa8-6767-4461-ad8c-563f5701a923 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099994 Aug 01 15:24:53.323912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 76/143] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:24:53 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:53.329135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:53.329731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:53.336513 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.336959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.337731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:53.338544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:53.666668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:53.675327 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e15d24cb-e07d-4942-98de-a2d9e71258bb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.349910 Aug 01 15:24:53.676277 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 77/144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:53 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:54.205472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:54.206214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:54.212485 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.212925 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.214123 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.214547 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.491462 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:54.499913 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95799c7a-9878-4f6f-b726-7362ffceea37 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.299112 Aug 01 15:24:54.500598 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 78/145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:54 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:54.706399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:54.707389 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:54.714326 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.714778 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.715551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.716132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.939959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:54.947695 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09218e4d-0284-4e93-b44d-d2ce6bc5a5a2 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.245541 Aug 01 15:24:54.948360 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 79/146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:54 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:54.953283 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-4783cc0a-0783-4911-adc7-05295c3d709b req-54e998d0-bb5b-420e-88c6-0187a638c346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061e74c4-3c31-46e4-af02-799b6e731274", "tag": "09d33995-f714-4442-b466-5fcfa7ebc913"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:54.963916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4783cc0a-0783-4911-adc7-05295c3d709b req-54e998d0-bb5b-420e-88c6-0187a638c346 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:54.964281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4783cc0a-0783-4911-adc7-05295c3d709b req-54e998d0-bb5b-420e-88c6-0187a638c346 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:54.976883 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-4783cc0a-0783-4911-adc7-05295c3d709b req-54e998d0-bb5b-420e-88c6-0187a638c346 service nova] Creating event network-changed:09d33995-f714-4442-b466-5fcfa7ebc913 for instance 061e74c4-3c31-46e4-af02-799b6e731274 on hv-cinder-84713 Aug 01 15:24:54.984789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-4783cc0a-0783-4911-adc7-05295c3d709b req-54e998d0-bb5b-420e-88c6-0187a638c346 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034960 Aug 01 15:24:54.985598 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 80/147] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:55.523691 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:55.524415 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:55.531457 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:55.531892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:55.532657 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:55.533083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:55.678191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:55.686259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31a392c3-93a5-4e70-90b2-4bb9724776cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.167164 Aug 01 15:24:55.686825 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 81/148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:55 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:55.970629 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:55.971236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:55.981771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:55.982243 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:55.983010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:55.983420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:56.139123 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:56.147231 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4a5b57c-7326-43eb-b385-f6a7a9880620 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1364 microversion: 2.1 time: 0.180639 Aug 01 15:24:56.147983 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 82/149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:55 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:56.711994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:56.713462 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:56.724292 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:56.725188 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:56.726549 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:56.727015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:56.872185 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:56.883461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7c5c7c25-095b-4333-98b7-41d8944e234c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.176353 Aug 01 15:24:56.885169 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 83/150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:56 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:57.168975 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:57.169564 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:57.175771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.176251 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.177009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.177439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.181620 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:57.320847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:57.330036 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0a91dfcf-748b-4f3b-9654-4e3de58d243a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1551 microversion: 2.1 time: 0.164645 Aug 01 15:24:57.330707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 84/151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:57 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:57.354213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-55161ccc-124b-473a-97ff-8646a74e6be0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:57.354728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-55161ccc-124b-473a-97ff-8646a74e6be0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:57.361049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55161ccc-124b-473a-97ff-8646a74e6be0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.361495 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55161ccc-124b-473a-97ff-8646a74e6be0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.362326 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55161ccc-124b-473a-97ff-8646a74e6be0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.362779 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-55161ccc-124b-473a-97ff-8646a74e6be0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.443479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-55161ccc-124b-473a-97ff-8646a74e6be0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093254 Aug 01 15:24:57.444100 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 85/152] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:24:57 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:57.905164 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:57.906531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:57.912779 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.913207 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:57.914067 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:57.914516 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:58.343038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:58.350759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-637b90c4-b01b-402a-a713-3fd6ace5f8b9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.449573 Aug 01 15:24:58.351456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 86/153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:57 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:58.717715 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e019636d-aaa9-4580-8ce6-c3b7fa122595 req-f23a696f-1899-4fe9-a85e-290fd80ab48f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762918ff-4812-4e05-be65-d3ab81a9ec32", "tag": "60a932ce-6123-415c-afb5-2c7b47a4a2e7"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:58.727872 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e019636d-aaa9-4580-8ce6-c3b7fa122595 req-f23a696f-1899-4fe9-a85e-290fd80ab48f service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:58.728296 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e019636d-aaa9-4580-8ce6-c3b7fa122595 req-f23a696f-1899-4fe9-a85e-290fd80ab48f service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:58.740805 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e019636d-aaa9-4580-8ce6-c3b7fa122595 req-f23a696f-1899-4fe9-a85e-290fd80ab48f service nova] Creating event network-changed:60a932ce-6123-415c-afb5-2c7b47a4a2e7 for instance 762918ff-4812-4e05-be65-d3ab81a9ec32 on hv-cinder-84713 Aug 01 15:24:58.746236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e019636d-aaa9-4580-8ce6-c3b7fa122595 req-f23a696f-1899-4fe9-a85e-290fd80ab48f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032105 Aug 01 15:24:58.746848 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 87/154] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:59.374315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:59.375024 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:59.383604 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:59.384066 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:59.385028 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:59.385528 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:59.527382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:59.535366 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d250cf0-d3a0-4b9e-a626-4a1181e1f0b7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.166506 Aug 01 15:24:59.536114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 88/155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:59 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:00.091338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-54774e85-21d3-4193-92f6-758730958f97 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "POST /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.905603 Aug 01 15:25:00.093920 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 68/156] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:24:53 2022] POST /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec/os-volume_attachments => generated 194 bytes in 6909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:00.558632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:00.561003 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:00.567685 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:00.568368 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:00.569133 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:00.569570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:00.791970 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:00.801397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-34083aaf-585e-4563-ae2f-758acf3bded2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.248396 Aug 01 15:25:00.802359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 89/157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:00 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:01.824212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:01.824969 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:01.827163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=95 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:01.833750 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:01.834228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:01.835031 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:01.835669 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:02.049185 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:02.057290 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b8b74923-8785-422f-ba10-685199be2c68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.238491 Aug 01 15:25:02.057890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 69/158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:01 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:03.082049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:03.082588 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:03.089488 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:03.089956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:03.090722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:03.091145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:03.284485 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:03.293423 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-437542ca-4de7-4bdf-a7a5-eb00cc85caa7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.215571 Aug 01 15:25:03.294439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 90/159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:03 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:04.315458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:04.316668 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:04.324064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:04.325067 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:04.326945 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:04.327515 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:04.589963 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:04.599463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4f1e3e15-b57d-457e-a5d8-bf0a3a21ea8b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.288146 Aug 01 15:25:04.602177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 70/160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:04 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:05.626829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:05.629256 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:05.678112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.678958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:05.684808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:05.685679 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:05.873688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:05.894385 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e21f9711-1f2d-437f-b067-7bc65fd9cc89 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.275864 Aug 01 15:25:05.900564 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 91/161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:05 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:06.918376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:06.919650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:06.927371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:06.928035 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:06.929005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:06.929596 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:07.084884 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:07.093372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1493d7c3-ddbe-4ec2-9775-cd0ad512fda3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.178751 Aug 01 15:25:07.093970 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 71/162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:06 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:08.115499 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:08.116197 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:08.123240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:08.124252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:08.125183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:08.126012 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:08.377383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:08.391344 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-42f3286f-f5e7-49fe-83fc-0bf6981bb10d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.281311 Aug 01 15:25:08.392004 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 92/163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:08 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:09.412988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:09.414422 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:09.422959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:09.423422 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:09.424158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:09.424677 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:09.584515 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:09.595293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4f8ae5a0-efb8-47bf-86be-e302476b1ac6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.186602 Aug 01 15:25:09.596588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 72/164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:09 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:10.620148 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:10.621764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:10.631435 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:10.632418 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:10.633889 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:10.634779 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:10.804494 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:10.815403 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d737a57f-ab34-40dd-a4ab-23a3ed0c9de5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.200238 Aug 01 15:25:10.815992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 93/165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:10 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:11.352190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2087879644", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:11.517161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] validate_networks() for None {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:25:11.836670 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:11.838190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:11.844969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:11.845658 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:11.846608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:11.847186 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:11.870554 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:25:11.871160 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:25:11.871704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:25:11.872185 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:25:11.872687 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:25:11.887061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:11.887587 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:11.888476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:11.888976 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:11.907839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Getting quotas for project 4ad608aec8b94f28aba65bfabd8e51e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:25:11.912504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Getting quotas for user 0b8be63e9d494662b9ca0cabf01e86ad and project 4ad608aec8b94f28aba65bfabd8e51e3. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:25:11.924686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:25:11.927322 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:25:12.009172 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-62cd3d28-f42b-46fb-bc2e-677ce616643c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667111 Aug 01 15:25:12.016719 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 73/166] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:25:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:25:12.019230 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:12.032249 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-73e153c7-17c8-4936-a59e-8cb684f021a0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:12.036584 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-73e153c7-17c8-4936-a59e-8cb684f021a0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:12.040318 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c384ef8e-d406-401c-a79b-3bd4094549bc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.207602 Aug 01 15:25:12.054247 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 94/167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:11 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:12.110914 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73e153c7-17c8-4936-a59e-8cb684f021a0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:12.118692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-73e153c7-17c8-4936-a59e-8cb684f021a0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1215 microversion: 2.1 time: 0.093446 Aug 01 15:25:12.120253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 74/168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:12 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:13.065083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:13.066554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:13.074363 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:13.075900 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:13.076962 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:13.077965 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:13.142845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:13.143380 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:13.153585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:13.154062 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:13.154878 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:13.157127 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:13.293967 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:13.305065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:13.324456 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2beee7f2-4ffc-4d8e-8fdf-c5ccf8ac33f6 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1219 microversion: 2.1 time: 0.185539 Aug 01 15:25:13.325323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 75/169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:13 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:13.344301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2535d99d-4048-494e-9a6e-b7ec9df0294b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.283154 Aug 01 15:25:13.346124 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 95/170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:13 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:14.354897 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:14.355886 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:14.376962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.377637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.378613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.379139 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.379471 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:14.385147 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:14.413261 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.413719 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.414544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:14.414983 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:14.578991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:14.591725 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-785707e6-56e8-404b-9683-b266b80bc83a tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1219 microversion: 2.1 time: 0.246430 Aug 01 15:25:14.605157 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 76/171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:14 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1219 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:14.681063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:14.689578 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d47a697f-3ae2-4514-ba58-714aea66f16b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.327137 Aug 01 15:25:14.691466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 96/172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:14 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:15.349504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d4d7014-6ca7-4629-8718-ecbfdcc1cef6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Action: 'create', calling method: .version_select at 0x7f03676ed0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2087018318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcBT7re7K34INjFULvAUZIYWy5NxKhqfy53BVa201Kgw1doSkA/17DQVL+AFmbsqVZsHTPg5AYQSlUrVddEZj3KUgw3GjvpoVsYG9SREAtxUJI8hSNaNjE9kQqOnldYFg=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:15.368739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9d4d7014-6ca7-4629-8718-ecbfdcc1cef6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for project 97f413eea3b945cc843040b11d501993. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:25:15.372994 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-9d4d7014-6ca7-4629-8718-ecbfdcc1cef6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for user 0898fda8be3743f093dbb216f21eb931 and project 97f413eea3b945cc843040b11d501993. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:25:15.399133 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d4d7014-6ca7-4629-8718-ecbfdcc1cef6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.259161 Aug 01 15:25:15.400701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 77/173] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:25:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:15.627905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:15.628620 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:15.640637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.641172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:15.642050 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.642734 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:15.724479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:15.725355 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:15.735338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.736171 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:15.737138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.737722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:15.747719 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:15.759371 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eaf9bdf8-8f1c-4a91-95b2-1f71d837b2af tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1267 microversion: 2.1 time: 0.133922 Aug 01 15:25:15.759550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 97/174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:15 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:15.938063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:15.938063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:15.947630 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.950118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:15.953246 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:15.953842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.001273 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:25:16.191645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:16.200350 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f201776-d468-415a-8297-3dbc98740040 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 204 len: 0 microversion: 2.1 time: 0.267377 Aug 01 15:25:16.201095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 98/175] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:15 2022] DELETE /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:25:16.202783 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:16.208302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a1f38c7-4cd5-449b-b44e-8551a5b2bc98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.490480 Aug 01 15:25:16.214563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 78/176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:15 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:16.215611 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:16.216469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:16.226936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.228548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.229323 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.229323 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.492983 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:16.502280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-52d3863c-c3d5-424d-bd81-24273f567759 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1554 microversion: 2.1 time: 0.292169 Aug 01 15:25:16.510269 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 99/177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:16 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1554 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:16.782459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:16.783082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:16.799441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.800162 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.802038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:16.802728 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:16.936463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:16.945049 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8fd97671-bee0-4a69-a10d-5ca2bd6b1a8e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1273 microversion: 2.1 time: 0.167544 Aug 01 15:25:16.947118 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 79/178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:16 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:17.229707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:17.230800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:17.238372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.239088 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.240023 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.240608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.269112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:17.524231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:17.525846 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:17.535094 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.535867 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.536843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.537489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.781157 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:17.783118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:17.791039 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e600077f-325e-4f67-9eb8-dfb7cb41a73e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.565906 Aug 01 15:25:17.793507 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b63935d6-f678-4e41-bd73-95a505f0a623 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1554 microversion: 2.1 time: 0.274081 Aug 01 15:25:17.794483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 80/179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:17 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:17.795740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 100/180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:17 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:17.968673 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:17.969283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:17.975787 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.976232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.977000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.977434 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.115443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:18.123036 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dab0f97d-1dd9-47a7-b939-0e107cd5c693 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.158537 Aug 01 15:25:18.123604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 81/181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:17 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:18.812783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:18.814095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:18.823165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.823886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.825206 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.826002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.827647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:18.828300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:18.838649 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.839196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.840029 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.840521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:19.052027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:19.060782 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b15c7cc-fe2f-4399-8cb2-b4f93f35a629 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.251955 Aug 01 15:25:19.061572 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 101/182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:18 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:19.063501 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:19.082082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-091d5845-2692-4021-a85b-bb0495349d6b tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1554 microversion: 2.1 time: 0.260285 Aug 01 15:25:19.082685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 82/183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:18 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:19.144808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:19.145340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:19.151800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:19.152245 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:19.153009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:19.153441 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:19.285706 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:19.296921 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7136854e-39d1-4cda-b6ea-71436007fee3 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.155695 Aug 01 15:25:19.297683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 102/184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:19 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:20.083150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:20.084200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:20.092984 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.093576 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.094519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.095041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.105832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:20.106896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:20.116915 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.117623 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.118891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.119426 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.330906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:20.343756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c9fdfc45-efa8-4ea2-b074-3a11471c873e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.264456 Aug 01 15:25:20.344107 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:20.344904 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 83/185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:20 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:20.352157 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:20.353143 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:20.358124 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af5c93b6-b805-43ad-9c02-d8e420f66937 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1554 microversion: 2.1 time: 0.258287 Aug 01 15:25:20.359068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 103/186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:20 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:20.361907 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.362343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.363119 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:20.363710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:20.507594 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:20.515592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-43910101-d7d7-486b-bd19-dbc90bf9c629 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.169363 Aug 01 15:25:20.516504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 84/187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:20 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:21.274564 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-41fe86ce-1c0e-4aa3-bd6f-f91c63d665dd req-2403d35c-1784-4070-ae24-81db33ad715a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54a4356c-7ece-40f5-ba29-0eb90ef47353", "tag": "e0b508b5-4f5c-4fe5-89a9-7284dba6e047"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:21.284171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-41fe86ce-1c0e-4aa3-bd6f-f91c63d665dd req-2403d35c-1784-4070-ae24-81db33ad715a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.284607 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-41fe86ce-1c0e-4aa3-bd6f-f91c63d665dd req-2403d35c-1784-4070-ae24-81db33ad715a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.295821 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-41fe86ce-1c0e-4aa3-bd6f-f91c63d665dd req-2403d35c-1784-4070-ae24-81db33ad715a service nova] Creating event network-changed:e0b508b5-4f5c-4fe5-89a9-7284dba6e047 for instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 on hv-cinder-84713 Aug 01 15:25:21.300962 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-41fe86ce-1c0e-4aa3-bd6f-f91c63d665dd req-2403d35c-1784-4070-ae24-81db33ad715a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030294 Aug 01 15:25:21.301509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 104/188] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:21.365627 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:21.366379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:21.373235 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.373643 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.374691 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.375122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.393722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:21.394529 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:21.401529 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.402038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.402805 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.403233 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.626615 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:21.630367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:21.636557 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4ba85b1e-9a8a-4f2b-8186-46cb85815dee tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.275393 Aug 01 15:25:21.637993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 85/189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:21 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:21.639420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-affcc694-0c4a-4301-945f-722e61ac6e46 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1554 microversion: 2.1 time: 0.263056 Aug 01 15:25:21.643834 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:21.644868 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:21.653614 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 105/190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:21 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:21.657124 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.657648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.658449 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:21.659357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:21.809681 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:21.817347 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6c534c7-729a-4663-bbe4-83c53d5f2b04 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.178200 Aug 01 15:25:21.817949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 86/191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:21 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:22.661022 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:22.661877 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:22.663794 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.664168 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:22.665235 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:22.670079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.670522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:22.671275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.671731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:22.672043 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.672627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:22.673395 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.674013 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:22.955999 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:22.964814 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1bbe1831-59d3-491b-a838-93bba931a7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.307631 Aug 01 15:25:22.965548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 106/192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:22 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:22.970652 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:22.971552 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:22.981311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:22.983290 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.983963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:22.985157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:22.986033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:23.059616 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:23.078181 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d3b7498-c058-400a-ae06-75405c745cfc tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1554 microversion: 2.1 time: 0.420866 Aug 01 15:25:23.081864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 87/193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:22 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1554 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:23.345263 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:23.353729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d8cd71a-b84e-4428-a3e4-bbee4b15e274 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.386832 Aug 01 15:25:23.354357 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 107/194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:22 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:23.745152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-56f82a88-02e4-4c83-8855-cd420a1e4690 req-84682c99-6bbe-40c4-93e2-4c2d08672a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a6869c6-e9dc-4b39-97c3-9b873bc1deec", "name": "network-vif-deleted", "tag": "fbf6bc89-9dd1-4c90-8ddd-84cbd4eff10f"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:23.755836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-56f82a88-02e4-4c83-8855-cd420a1e4690 req-84682c99-6bbe-40c4-93e2-4c2d08672a35 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:23.756316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-56f82a88-02e4-4c83-8855-cd420a1e4690 req-84682c99-6bbe-40c4-93e2-4c2d08672a35 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:23.770389 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-56f82a88-02e4-4c83-8855-cd420a1e4690 req-84682c99-6bbe-40c4-93e2-4c2d08672a35 service nova] Creating event network-vif-deleted:fbf6bc89-9dd1-4c90-8ddd-84cbd4eff10f for instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec on hv-cinder-84713 Aug 01 15:25:23.776004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-56f82a88-02e4-4c83-8855-cd420a1e4690 req-84682c99-6bbe-40c4-93e2-4c2d08672a35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034473 Aug 01 15:25:23.776613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 88/195] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:23.990975 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:23.991529 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:23.998212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:23.998646 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:23.999423 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:23.999854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.101483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:24.102122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:24.109087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.109538 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.110449 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.110902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.144338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:24.152456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b722609-dda7-4096-ab13-0fed4a53a35d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.165463 Aug 01 15:25:24.154033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 108/196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:23 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:24.183208 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:24.192283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bda4fe60-efee-49f5-b69d-4631f1218dcd tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1512 microversion: 2.1 time: 0.095234 Aug 01 15:25:24.193257 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 89/197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:24 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1512 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:24.375305 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:24.375818 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:24.383904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.384634 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.385637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:24.386275 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:24.523661 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:24.531891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9834aead-d33f-4234-a83b-721b453828c1 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.160508 Aug 01 15:25:24.532469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 109/198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:24 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:25.173078 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:25.173942 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:25.180752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.181217 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.182016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.182454 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.214762 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:25.215309 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:25.224020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.224911 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.225506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.226097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.309167 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:25.317763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e9a30913-210d-4fa6-96fc-dec31a04f72c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1512 microversion: 2.1 time: 0.107626 Aug 01 15:25:25.317763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 110/199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:25 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:25.347812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:25.355351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5429c5df-f22f-41d5-a217-8bba0941cb66 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.186063 Aug 01 15:25:25.362470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 90/200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:25 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:25.555872 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:25.556466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:25.563610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.564049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.564811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.565235 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.709679 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:25.718397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-61bc8422-1486-46b2-9cca-4ca8368bf70c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.167067 Aug 01 15:25:25.718969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 111/201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:25 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:26.339262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.339890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.341911 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=12 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:26.348202 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.348652 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.349420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.349871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.376118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.376738 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.383750 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.384184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.385143 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.385650 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.415069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:26.423376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2b07a2b9-6d9b-4f53-aab3-e1f745812146 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1512 microversion: 2.1 time: 0.088413 Aug 01 15:25:26.423967 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 91/202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:26 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1512 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:26.524019 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:26.531571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bbfae05d-d433-4240-b683-a58638e16df4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.159319 Aug 01 15:25:26.532139 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 112/203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:26 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:26.742695 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.743200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.751704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.752337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.753151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.753624 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.900370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:26.910540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-736a2920-0d32-452c-9fab-94d797de2d2d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.171848 Aug 01 15:25:26.911211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 92/204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:26 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:27.445774 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:27.446489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:27.458413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.459018 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.460245 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.460889 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.530818 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:27.544470 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ecaf5ac-048d-4442-b4e3-6728ce72b2b9 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1346 microversion: 2.1 time: 0.103221 Aug 01 15:25:27.545403 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 113/205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:27 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:27.552497 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:27.553241 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:27.560415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.560861 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.561628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.562074 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.733864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:27.743065 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c97db6d6-e5d1-45bb-aa0f-0eb265d97ce8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1520 microversion: 2.1 time: 0.194506 Aug 01 15:25:27.744433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 93/206] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:27 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:27.932560 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:27.933202 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:27.940015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.940784 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:27.941640 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.942172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.159571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.168033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3cf02f1f-b110-4c25-a0ff-2e826867dd49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.239507 Aug 01 15:25:28.168608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 114/207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:27 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:28.569112 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:28.569112 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:28.575881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.576342 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.577119 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.577628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.615456 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.616045 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.616571 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lazy-loading 'fault' on Instance uuid 2a6869c6-e9dc-4b39-97c3-9b873bc1deec {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:25:28.663161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.671706 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a082b803-dff4-485e-88bd-e9ce66787a1d tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1351 microversion: 2.1 time: 0.108633 Aug 01 15:25:28.672283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 94/208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:28 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:28.764606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:28.765191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:28.771315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.771750 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.772666 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.773091 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.913603 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.922597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c4a6363b-d220-4bab-8d15-09f022569aca tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1500 microversion: 2.1 time: 0.161811 Aug 01 15:25:28.923182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 115/209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:28 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:28.942519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:28.943130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:28.949972 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.950409 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.951220 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.951679 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.191069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:29.191675 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:29.198500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.198949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.199714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.200144 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.253394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:29.255668 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:29.262763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8cc6a34a-4148-4a73-b0de-4ba075b20c0e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1515 microversion: 2.1 time: 0.324146 Aug 01 15:25:29.263548 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 95/210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:28 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:29.347523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:29.355163 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2093b38-8eab-465a-bb48-55281ee7a97b tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.170024 Aug 01 15:25:29.355741 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 116/211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:29 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:29.694303 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:29.695088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:29.702681 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.703386 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.704323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.712833 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.739879 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.740326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.740901 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lazy-loading 'fault' on Instance uuid 2a6869c6-e9dc-4b39-97c3-9b873bc1deec {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:25:29.788441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:29.796368 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d32497a0-4e2e-4699-a491-97627acdad04 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1351 microversion: 2.1 time: 0.107356 Aug 01 15:25:29.797130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 96/212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:29 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:30.375995 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:30.376592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:30.383475 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.383908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.384716 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.385218 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.406314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:30.530385 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:30.538545 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7e56fa6-d1b1-4682-856f-121b6342541c tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.166417 Aug 01 15:25:30.539133 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 117/213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:30 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:30.661391 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:30.663720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:30.669924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.670370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.671136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.671563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.696092 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lazy-loading 'flavor' on Instance uuid 9acf39c9-3133-40e5-8942-df02938d1af6 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:25:30.784792 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-938da48c-5831-4001-9bd6-50fb8042171f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6/action" status: 200 len: 32 microversion: 2.1 time: 0.127497 Aug 01 15:25:30.785506 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 97/214] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:25:30 2022] POST /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:25:30.796287 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:30.796891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:30.804068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.804489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.805273 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.805703 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.819112 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:30.819794 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:30.832055 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.832569 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.833269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.833695 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.870541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.871477 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.871477 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lazy-loading 'fault' on Instance uuid 2a6869c6-e9dc-4b39-97c3-9b873bc1deec {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:25:30.937693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:30.946358 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0c7f80ac-362d-47f5-8241-af9d8a8dd99c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1351 microversion: 2.1 time: 0.131429 Aug 01 15:25:30.946908 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 98/215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:30 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:30.989808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:31.002161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-baf0918f-c2ea-4643-90a4-6fea3d01881c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.210358 Aug 01 15:25:31.002721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 118/216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:30 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:31.559622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:31.560225 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:31.566861 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.567534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:31.568261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.568703 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:31.710597 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:31.719290 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7fafe8e7-bab1-4a6c-84d2-6c9583ce2476 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.163312 Aug 01 15:25:31.719848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 99/217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:31 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:31.967501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:31.968179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:31.975083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.975543 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:31.976331 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:31.976771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.011626 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.012058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.012518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lazy-loading 'fault' on Instance uuid 2a6869c6-e9dc-4b39-97c3-9b873bc1deec {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:25:32.024178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:32.024784 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:32.026811 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:32.032656 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.033098 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.033889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.034420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.059479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:32.068645 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-92e0dd3c-c1dd-4ad7-afe6-59eae6cafa3c tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1351 microversion: 2.1 time: 0.104978 Aug 01 15:25:32.069241 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 119/218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:31 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:32.185761 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:32.195478 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-afac4fd7-5944-4b37-bd1d-be915f92be68 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.175838 Aug 01 15:25:32.196366 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 100/219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:32 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:32.740407 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:32.741023 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:32.747663 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.748116 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.748880 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.749308 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.887962 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:32.897507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7c905bd5-2766-4d69-aa5e-04b914c9130e tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.160784 Aug 01 15:25:32.897970 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 120/220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:32 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:33.093349 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.094089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.101622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.102092 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.102860 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.103315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.136734 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.137179 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.137704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lazy-loading 'fault' on Instance uuid 2a6869c6-e9dc-4b39-97c3-9b873bc1deec {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:25:33.181097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6945b8e606f40f1b79bd4aab96a7f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13cfc3643554bc785b182b3699058e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:33.191742 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-69bc02bc-9f75-48fb-9ae5-ae942fa65280 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 200 len: 1351 microversion: 2.1 time: 0.102133 Aug 01 15:25:33.192628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 101/221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:33 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:33.217190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.218095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.224219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.224789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.225663 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.226123 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.376572 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:33.385916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-703a689c-5976-4056-b234-e941dcf23844 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.172467 Aug 01 15:25:33.386561 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 121/222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:33 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:33.919411 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.919927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.926166 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.926829 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.927598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.928246 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.177255 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:34.186672 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a5dee16-b6ee-42a1-b375-3b5ce58c7b49 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.271173 Aug 01 15:25:34.187269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 102/223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:33 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:34.213053 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:34.213655 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:34.219871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.220655 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.221119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.221579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.241716 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] HTTP exception thrown: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Request method failure captured: Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec HTTP/1.1 Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_ASZ-IZNs19zHF8JPdfcP_dQQrRRhAkrzsLYZL_PbgjpQahcwQSK8-8rNUeL1IKecwKypbQt2GqtwTP5XpdDyQLyyfxaZCKqXwrESwgDHfkQIN01t9fZxjuiwF6op800OA3JCOjmVPAftJMQuFsoXD7MDxp6IZv6IEm25KtN6maO3c Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:25:34.246888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b13cfc3643554bc785b182b3699058e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}] Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: e6945b8e606f40f1b79bd4aab96a7f1a Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.248444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '2a6869c6-e9dc-4b39-97c3-9b873bc1deec'} Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:34.249282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.250733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.252455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Returning 404 to user: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:34.252455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-869fa0ec-e4dd-4a13-951b-c74fe51cacda tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 404 len: 111 microversion: 2.1 time: 0.039528 Aug 01 15:25:34.252455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 122/224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:34 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:34.367560 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:34.370011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:34.376249 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.376694 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.377444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.377897 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.395114 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] HTTP exception thrown: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Request method failure captured: Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec/os-volume_attachments HTTP/1.1 Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_ASZ-IZNs19zHF8JPdfcP_dQQrRRhAkrzsLYZL_PbgjpQahcwQSK8-8rNUeL1IKecwKypbQt2GqtwTP5XpdDyQLyyfxaZCKqXwrESwgDHfkQIN01t9fZxjuiwF6op800OA3JCOjmVPAftJMQuFsoXD7MDxp6IZv6IEm25KtN6maO3c Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:25:34.400134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b13cfc3643554bc785b182b3699058e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}] Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: e6945b8e606f40f1b79bd4aab96a7f1a Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.401299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '2a6869c6-e9dc-4b39-97c3-9b873bc1deec'} Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:34.402007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:34.403153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:34.404423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Returning 404 to user: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:34.404423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff2fb69b-584c-4763-8fb0-7f302fd6a010 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038257 Aug 01 15:25:34.404423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 103/225] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:25:34 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:34.410304 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:34.410912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:34.417350 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.417877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.418581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.419173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.595531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:34.604109 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-605f8c66-e3bb-4da3-8a48-5839c2164bd4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.198070 Aug 01 15:25:34.604676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 123/226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:34 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:35.208332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:35.209074 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:35.217648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.218121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.218878 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.219307 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.364228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:35.372176 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-deaa3c05-4c79-4418-a5a3-05e3070d1782 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.167812 Aug 01 15:25:35.372878 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 104/227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:35 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:35.625043 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:35.625888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:35.632618 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.632965 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.633921 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.634211 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.641998 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:35.642569 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:35.648736 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.649184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.649988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.650408 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.663995 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] HTTP exception thrown: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Request method failure captured: Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec HTTP/1.1 Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_ASZ-IZNs19zHF8JPdfcP_dQQrRRhAkrzsLYZL_PbgjpQahcwQSK8-8rNUeL1IKecwKypbQt2GqtwTP5XpdDyQLyyfxaZCKqXwrESwgDHfkQIN01t9fZxjuiwF6op800OA3JCOjmVPAftJMQuFsoXD7MDxp6IZv6IEm25KtN6maO3c Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:25:35.666184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b13cfc3643554bc785b182b3699058e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}] Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: e6945b8e606f40f1b79bd4aab96a7f1a Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.667613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '2a6869c6-e9dc-4b39-97c3-9b873bc1deec'} Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:35.668407 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.669712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.671031 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Returning 404 to user: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:35.671031 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a976edcf-65dd-4147-8271-b4e3122fb799 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 404 len: 111 microversion: 2.1 time: 0.029469 Aug 01 15:25:35.671448 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 105/228] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:35 2022] DELETE /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:25:35.675628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:35.676206 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] [instance: 2a6869c6-e9dc-4b39-97c3-9b873bc1deec] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:35.682516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.682966 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.683737 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.684172 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.698338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] HTTP exception thrown: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Request method failure captured: Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec HTTP/1.1 Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_ASZ-IZNs19zHF8JPdfcP_dQQrRRhAkrzsLYZL_PbgjpQahcwQSK8-8rNUeL1IKecwKypbQt2GqtwTP5XpdDyQLyyfxaZCKqXwrESwgDHfkQIN01t9fZxjuiwF6op800OA3JCOjmVPAftJMQuFsoXD7MDxp6IZv6IEm25KtN6maO3c Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:25:35.699864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b13cfc3643554bc785b182b3699058e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b13cfc3643554bc785b182b3699058e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b13cfc3643554bc785b182b3699058e2"}]}] Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: b13cfc3643554bc785b182b3699058e2 Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-DeleteServersTestJSON-11014881 Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: e6945b8e606f40f1b79bd4aab96a7f1a Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-DeleteServersTestJSON-11014881-project Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.701190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '2a6869c6-e9dc-4b39-97c3-9b873bc1deec'} Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:35.702267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. Aug 01 15:25:35.703697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.704851 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] Returning 404 to user: Instance 2a6869c6-e9dc-4b39-97c3-9b873bc1deec could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:35.704851 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c462a2f8-27b1-42f1-ade7-1b13f13ab203 tempest-DeleteServersTestJSON-11014881 tempest-DeleteServersTestJSON-11014881-project] 10.222.0.48 "GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec" status: 404 len: 111 microversion: 2.1 time: 0.029148 Aug 01 15:25:35.704851 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 106/229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:35 2022] GET /compute/v2.1/servers/2a6869c6-e9dc-4b39-97c3-9b873bc1deec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:35.775057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:35.783806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1a6c052-a49a-434f-b5dc-7b15754b2aa1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.162721 Aug 01 15:25:35.784385 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 124/230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:35 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:36.051737 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-22a88494-e06d-4e8e-a9bc-444dd32b1c69 req-e7465b73-5a68-47d3-b887-390e4644882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a4356c-7ece-40f5-ba29-0eb90ef47353", "name": "network-vif-plugged", "status": "completed", "tag": "e0b508b5-4f5c-4fe5-89a9-7284dba6e047"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:36.062218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-22a88494-e06d-4e8e-a9bc-444dd32b1c69 req-e7465b73-5a68-47d3-b887-390e4644882d service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.062759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-22a88494-e06d-4e8e-a9bc-444dd32b1c69 req-e7465b73-5a68-47d3-b887-390e4644882d service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.075882 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-22a88494-e06d-4e8e-a9bc-444dd32b1c69 req-e7465b73-5a68-47d3-b887-390e4644882d service nova] Creating event network-vif-plugged:e0b508b5-4f5c-4fe5-89a9-7284dba6e047 for instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 on hv-cinder-84713 Aug 01 15:25:36.081087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-22a88494-e06d-4e8e-a9bc-444dd32b1c69 req-e7465b73-5a68-47d3-b887-390e4644882d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033339 Aug 01 15:25:36.081749 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 107/231] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:25:36.393656 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:36.394408 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:36.402066 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.402518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.403272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.403738 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.569976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:36.578355 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8e680e6a-bbc3-45ea-a752-b2c2aeb085d4 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.188484 Aug 01 15:25:36.579151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 125/232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:36 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:36.805952 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:36.806635 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:36.814029 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.814467 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.815245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:36.815675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:36.956596 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:36.966476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-da5ebf64-e015-4624-b573-78825ad6c21b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.165560 Aug 01 15:25:36.967059 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 108/233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:36 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:37.606449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:37.607285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:37.615698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:37.616182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:37.617170 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:37.617752 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:37.751549 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:37.760372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d68ef332-8f46-4e03-874f-cb25aa9ed7b9 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1315 microversion: 2.1 time: 0.157795 Aug 01 15:25:37.775922 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 126/234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:37 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:37.990286 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:37.991053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:37.997475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:37.997981 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:37.998761 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:37.999196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:38.152704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:38.160323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-480bb1cd-691d-497e-adb4-f00f771a56b2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.174332 Aug 01 15:25:38.160898 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 109/235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:37 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:38.784254 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:38.785044 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:38.795910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:38.796434 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:38.797225 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:38.797675 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:38.955015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:38.964157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c21b3c76-b618-4490-be14-5f7b6bf5bc1d tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1465 microversion: 2.1 time: 0.183709 Aug 01 15:25:38.964766 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 127/236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:38 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:39.017740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:39.017740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:39.025526 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.025980 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.027461 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.028077 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.055259 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:25:39.109825 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:39.155452 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a0b974b-56b3-48c0-914f-9899016f2ad2 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "DELETE /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 204 len: 0 microversion: 2.1 time: 0.142597 Aug 01 15:25:39.156056 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 110/237] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:39 2022] DELETE /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:39.166500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:39.167682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:39.176476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.177576 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.178654 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.179347 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.181226 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:39.185491 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:39.199116 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.199748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.206661 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:39.207562 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:39.416175 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:39.429952 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3b1553fe-86c5-4525-a4d9-1314194f26fa tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1471 microversion: 2.1 time: 0.269392 Aug 01 15:25:39.446683 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:39.454897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 128/238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:39 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1471 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:39.461184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a4ebd822-40c2-47a9-bc79-e72b50d434db tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.283655 Aug 01 15:25:39.462413 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 111/239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:39 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:40.460704 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:40.461311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:40.467931 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.468657 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.469630 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.470269 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.482508 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:40.483280 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:40.491136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.491341 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.492278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:40.493006 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:40.750849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:40.754887 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:40.760516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e14f2bf6-e277-4e1a-b5a5-8b1c0062ed98 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.281749 Aug 01 15:25:40.761097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 112/240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:40 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:40.764279 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d4ad4e8b-43e1-499b-9add-0efca859ccb0 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1471 microversion: 2.1 time: 0.307486 Aug 01 15:25:40.778279 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 129/241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:40 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:41.288588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-344100859", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2087018318", "security_groups": [{"name": "tempest-secgroup-smoke-2024196989"}], "block_device_mapping_v2": [{"uuid": "a32fa661-1d12-401c-afcc-e3dbf08c74b6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cde6e32b-9ffe-4036-ade9-45f54f08a2da"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:41.469077 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] validate_networks() for [('cde6e32b-9ffe-4036-ade9-45f54f08a2da', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:25:41.787412 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:41.791209 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:41.800461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:41.801249 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:41.802545 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:41.803469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.134021 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:42.148300 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a4f946a1-c01b-4bf5-826a-387ed4cc2663 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.368802 Aug 01 15:25:42.149102 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 130/242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:41 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:42.155336 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:42.155948 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:42.163000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:42.163448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.164228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:42.165659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.301904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be63e9d494662b9ca0cabf01e86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad608aec8b94f28aba65bfabd8e51e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:42.309878 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-213b9e44-70cf-4ba5-b8fa-155247d28920 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 200 len: 1429 microversion: 2.1 time: 0.158552 Aug 01 15:25:42.310469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 131/243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:42 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 1429 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:42.315845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:25:42.316812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:25:42.317455 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:25:42.318057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:25:42.318644 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:25:42.340876 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:42.341494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.342496 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:42.343115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.393598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for project 97f413eea3b945cc843040b11d501993. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:25:42.398668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a7822f6d-9b0a-4acc-8bb2-120e5d3fe25c req-786638b5-8a7b-4477-99cd-17ac1eed705c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a4356c-7ece-40f5-ba29-0eb90ef47353", "name": "network-vif-deleted", "tag": "e0b508b5-4f5c-4fe5-89a9-7284dba6e047"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:42.401280 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for user 0898fda8be3743f093dbb216f21eb931 and project 97f413eea3b945cc843040b11d501993. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:25:42.415394 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a7822f6d-9b0a-4acc-8bb2-120e5d3fe25c req-786638b5-8a7b-4477-99cd-17ac1eed705c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:42.421494 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a7822f6d-9b0a-4acc-8bb2-120e5d3fe25c req-786638b5-8a7b-4477-99cd-17ac1eed705c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:42.438540 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a7822f6d-9b0a-4acc-8bb2-120e5d3fe25c req-786638b5-8a7b-4477-99cd-17ac1eed705c service nova] Creating event network-vif-deleted:e0b508b5-4f5c-4fe5-89a9-7284dba6e047 for instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 on hv-cinder-84713 Aug 01 15:25:42.446458 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a7822f6d-9b0a-4acc-8bb2-120e5d3fe25c req-786638b5-8a7b-4477-99cd-17ac1eed705c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054364 Aug 01 15:25:42.453064 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 132/244] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:25:42.527499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:25:42.529739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a32fa661-1d12-401c-afcc-e3dbf08c74b6',volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:25:42.700252 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-79b8c073-6dd3-4d08-af1a-747e25ebe1ce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.415786 Aug 01 15:25:42.700966 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 113/245] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:25:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:25:42.712692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9df76e4d-5b96-4b16-82a1-b58964552e88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:42.713387 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9df76e4d-5b96-4b16-82a1-b58964552e88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:42.805090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9df76e4d-5b96-4b16-82a1-b58964552e88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:42.814190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9df76e4d-5b96-4b16-82a1-b58964552e88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1094 microversion: 2.1 time: 0.105547 Aug 01 15:25:42.817096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 133/246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:42 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:43.171163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:43.172101 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:43.179799 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.180253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.181144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.181796 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.334453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:43.335919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] [instance: 54a4356c-7ece-40f5-ba29-0eb90ef47353] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:43.345257 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.345830 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.346860 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.347550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.364812 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] HTTP exception thrown: Instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 could not be found. Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Request method failure captured: Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 HTTP/1.1 Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_BSOoCbPipa9uFnI8-qWYW-Wrv3MFMpguTpPD-uTOYXEtnMu7RPxCXjRyi-5moPO9DIsNUmzj02OJmSIRtf9c1XhT1n4CItRhgdE7OtDRHQGaj7HnkKdqFma4RmkV8G14sWRzjVeMWNLyQBPa-dgBL9jT07s0q9h9s5DzyUNRG4fJI Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 4ad608aec8b94f28aba65bfabd8e51e3 Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-2094519678 Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:25:43.366832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ad608aec8b94f28aba65bfabd8e51e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4ad608aec8b94f28aba65bfabd8e51e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4ad608aec8b94f28aba65bfabd8e51e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ad608aec8b94f28aba65bfabd8e51e3"}]}] Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-2094519678 Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 4ad608aec8b94f28aba65bfabd8e51e3 Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-2094519678 Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-2094519678-project Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 0b8be63e9d494662b9ca0cabf01e86ad Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-2094519678-project Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 could not be found. Aug 01 15:25:43.368009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '54a4356c-7ece-40f5-ba29-0eb90ef47353'} Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 could not be found. Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:43.368668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 could not be found. Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 could not be found. Aug 01 15:25:43.369936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:25:43.370945 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:43.372884 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] Returning 404 to user: Instance 54a4356c-7ece-40f5-ba29-0eb90ef47353 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:43.374076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1760f771-6138-4b87-aa3a-5fb334ff7783 tempest-VolumesNegativeTest-2094519678 tempest-VolumesNegativeTest-2094519678-project] 10.222.0.48 "GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353" status: 404 len: 111 microversion: 2.1 time: 0.045399 Aug 01 15:25:43.378937 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 134/247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:43 2022] GET /compute/v2.1/servers/54a4356c-7ece-40f5-ba29-0eb90ef47353 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:43.392035 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c388ebf7-2fb5-4184-b113-f54f2ebdba64 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.224985 Aug 01 15:25:43.392617 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 114/248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:43 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:43.838852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:43.839507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:43.847709 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.848159 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.848961 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:43.849436 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:43.915718 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:43.923431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d687b549-7eed-4d39-b080-2d7f2958c261 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1192 microversion: 2.1 time: 0.089433 Aug 01 15:25:43.937125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 135/249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:43 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:44.415227 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:44.416433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:44.430387 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.430940 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:44.431783 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.432212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:44.688261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:44.698874 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-287056f1-23ec-4c14-8323-22b095940d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.288813 Aug 01 15:25:44.700096 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 115/250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:44 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:44.948490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:44.949156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:44.967786 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.968601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:44.968985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:44.969448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:45.584102 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:45.587944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.592466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7ef9ad2f-9076-4bc0-ad9e-5a6205d49c09 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.652555 Aug 01 15:25:45.607040 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 136/251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:44 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:45.730430 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:45.731038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:45.738634 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:45.739432 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:45.740257 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:45.740687 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:45.968008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:45.982520 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fac10f79-d778-4fd4-92ef-61344a33aba9 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.263126 Aug 01 15:25:45.983947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 116/252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:45 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:46.216737 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-131b4ca6-2d16-4f57-902f-33447184d47b req-728df450-761d-4c4c-ad87-75815160599c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e", "tag": "c68be1f7-d774-45ae-ae98-631e16953453"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:46.228618 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-131b4ca6-2d16-4f57-902f-33447184d47b req-728df450-761d-4c4c-ad87-75815160599c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:46.229053 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-131b4ca6-2d16-4f57-902f-33447184d47b req-728df450-761d-4c4c-ad87-75815160599c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:46.241472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-131b4ca6-2d16-4f57-902f-33447184d47b req-728df450-761d-4c4c-ad87-75815160599c service nova] Creating event network-changed:c68be1f7-d774-45ae-ae98-631e16953453 for instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e on hv-cinder-84713 Aug 01 15:25:46.254610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-131b4ca6-2d16-4f57-902f-33447184d47b req-728df450-761d-4c4c-ad87-75815160599c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037044 Aug 01 15:25:46.255783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 137/253] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:46.614136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:46.615058 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:46.626745 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:46.627295 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:46.628236 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:46.628984 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:46.836062 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:46.849004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f39072e-0906-439a-afbf-ea0f5e1870dc tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.238881 Aug 01 15:25:46.850447 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 117/254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:46 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:47.008114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:47.009258 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:47.031402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.032176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:47.033569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.036771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:47.227603 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:47.242696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-449fa856-e598-4bdd-b910-e7c708c66ed3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.241541 Aug 01 15:25:47.246025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 138/255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:46 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:47.875372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:47.876574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:47.884588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.885022 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:47.886232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:47.886995 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.135981 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:48.148088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f344466-8f3e-47da-861b-b288d47a0443 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.276220 Aug 01 15:25:48.151495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 118/256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:47 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:48.269610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:48.270920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:48.283219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.284014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.285698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.286436 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.599343 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:48.609466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d603498c-532d-4698-8768-e70609097850 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1501 microversion: 2.1 time: 0.346249 Aug 01 15:25:48.610289 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 139/257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:48 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1501 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:48.631637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73708168-c63d-4ce4-9f04-3467146c2872"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:48.634398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:48.640780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.641226 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.642176 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.642619 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.668896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] HTTP exception thrown: Cannot 'attach_volume' instance 9acf39c9-3133-40e5-8942-df02938d1af6 while it is in vm_state rescued Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Request method failure captured: Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6/os-volume_attachments HTTP/1.1 Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 74 Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AOu_gdPJh0fnK6IS6_RTfqlgP9yrCVUGQhjW_TZeS1pFWe7vx8I5l9_sgQyQZoDiqSD5GtGFTLQuG5OUSscK7EY_2AKImIIGZJWxUiBnAzw94Vx0O3XIMK_l0OwZ2sdoCKY_nEhejN9WsqralWbhs4hTuS-P0k6e3k4fdszvGJ9K4 Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:25:48.670803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}] Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 6f852249c66a4f8986d7a63a957ec91c Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {"volumeAttachment": {"volumeId": "73708168-c63d-4ce4-9f04-3467146c2872"}} Aug 01 15:25:48.672135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Cannot 'attach_volume' instance 9acf39c9-3133-40e5-8942-df02938d1af6 while it is in vm_state rescued Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '9acf39c9-3133-40e5-8942-df02938d1af6', 'body': {'volumeAttachment': {'volumeId': '73708168-c63d-4ce4-9f04-3467146c2872'}}} Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9acf39c9-3133-40e5-8942-df02938d1af6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:48.672932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9acf39c9-3133-40e5-8942-df02938d1af6 while it is in vm_state rescued Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:48.674251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:48.675485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:48.675485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:48.675485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9acf39c9-3133-40e5-8942-df02938d1af6 while it is in vm_state rescued Aug 01 15:25:48.675485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:25:48.676662 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Returning 409 to user: Cannot 'attach_volume' instance 9acf39c9-3133-40e5-8942-df02938d1af6 while it is in vm_state rescued {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:48.678041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7aea8e36-790f-4a22-ab8b-488c9284c211 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051193 Aug 01 15:25:48.678758 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 119/258] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:25:48 2022] POST /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:25:48.687806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d331a566-9aa5-45a8-be19-a6af6bd36912 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:48.688357 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d331a566-9aa5-45a8-be19-a6af6bd36912 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:48.695410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d331a566-9aa5-45a8-be19-a6af6bd36912 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.695863 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d331a566-9aa5-45a8-be19-a6af6bd36912 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.696795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d331a566-9aa5-45a8-be19-a6af6bd36912 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.697228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d331a566-9aa5-45a8-be19-a6af6bd36912 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.935898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d331a566-9aa5-45a8-be19-a6af6bd36912 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6/action" status: 202 len: 0 microversion: 2.1 time: 0.251497 Aug 01 15:25:48.936890 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 140/259] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:25:48 2022] POST /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:25:48.946509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:48.948247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:48.956729 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.959231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:48.963458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:48.964090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:49.172825 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:49.173578 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:49.180763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:49.181363 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:49.182171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:49.182602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:49.476615 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:49.485273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-53ec1070-acd5-4829-8c99-d6fac7489d4b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1509 microversion: 2.1 time: 0.542467 Aug 01 15:25:49.485915 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 120/260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:48 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:49.790097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:49.800642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4022e66-a6de-4d15-8eb3-5a8b7591dd58 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.632993 Aug 01 15:25:49.801404 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 141/261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:49 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:50.510343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:50.511036 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:50.517518 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.517980 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.518736 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.519157 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.670665 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:50.679275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c96f955c-3f82-4690-87b4-b1b1fb12def2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1509 microversion: 2.1 time: 0.172650 Aug 01 15:25:50.680069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 121/262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:50 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:50.821883 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:50.822478 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:50.828489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.828794 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:50.829525 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:50.830154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.059826 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:51.068636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0467c8c3-0f52-48e4-9221-d0e6a1c5a126 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.250377 Aug 01 15:25:51.098615 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 142/263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:50 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:51.703103 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:51.704467 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:51.712544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:51.713247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.714236 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:51.714822 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:51.866102 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:51.874885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-85d6c24f-ef81-440e-b141-0fd0dcf35616 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1509 microversion: 2.1 time: 0.177276 Aug 01 15:25:51.875626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 122/264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:51 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:52.091749 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:52.092452 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:52.098677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.099210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:52.099968 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.100397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:52.236940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:52.244506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0b806d44-5c8a-4726-ab84-4992ddf596c2 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.156867 Aug 01 15:25:52.259278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 143/265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:52 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:52.899198 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:52.899778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:52.901964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.902530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:52.910208 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.910653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:52.911525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:52.911986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:53.147151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:53.154905 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9631dc27-b136-444d-b12d-8c252992cbb7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1515 microversion: 2.1 time: 0.259650 Aug 01 15:25:53.155482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 123/266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:52 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:53.267196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.268620 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:53.275015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:53.275973 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=78 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:53.278316 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:53.278945 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:53.279882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:53.280548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:53.472834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:53.482957 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dbff1126-2457-463e-b5f1-c6e406539dc7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.220023 Aug 01 15:25:53.483648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 144/267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:54.504610 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:54.505278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:54.511926 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:54.512367 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:54.513114 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:54.513539 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:54.650265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:54.657805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-62706a8b-f1c4-4565-8ae7-8a0fee124751 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.157124 Aug 01 15:25:54.658379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 124/268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:54 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:55.679462 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:55.680038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:55.686692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:55.687151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:55.688048 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:55.688486 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:55.822613 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:55.831237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-39e1b4e3-795b-408f-aeae-24472d42cb3e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.156440 Aug 01 15:25:55.831834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 145/269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:55 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:56.761528 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-07515059-29b2-45fa-8996-bce40c57ee44 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'create', calling method: .version_select at 0x7f03675fdc10>, body: {"keypair": {"name": "tempest-keypair-1562267991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5yEFC11ABYKsYPnd+ozQrdgFb97tbC7UfarLvKNtdnZBCUHIDD+Zj+jHv7CV9Q3VUkg9JqOjFWVZWLWKFbsnNBaOGtcRCAkMuwDTWFB76kcjA5kP4KnF1hxp2WhhzFIQ=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:56.777981 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-07515059-29b2-45fa-8996-bce40c57ee44 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for project a359662d2a444976af8b1b9cc351edb9. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:25:56.784090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-07515059-29b2-45fa-8996-bce40c57ee44 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for user 6f852249c66a4f8986d7a63a957ec91c and project a359662d2a444976af8b1b9cc351edb9. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:25:56.812122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-07515059-29b2-45fa-8996-bce40c57ee44 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054291 Aug 01 15:25:56.812752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 125/270] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:25:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:56.854151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:56.854696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:56.861186 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:56.861920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:56.862677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:56.863356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:57.039727 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:57.047735 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d7b60aba-d82c-482c-98c3-cb4c4217639e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.197324 Aug 01 15:25:57.058035 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 146/271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:56 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:58.000785 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2981122a-7e0d-4fdd-a867-ca95f86c28fc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:58.001415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2981122a-7e0d-4fdd-a867-ca95f86c28fc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:58.009516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2981122a-7e0d-4fdd-a867-ca95f86c28fc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.010089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2981122a-7e0d-4fdd-a867-ca95f86c28fc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.010923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2981122a-7e0d-4fdd-a867-ca95f86c28fc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.011427 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2981122a-7e0d-4fdd-a867-ca95f86c28fc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.037881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2981122a-7e0d-4fdd-a867-ca95f86c28fc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/ips" status: 200 len: 147 microversion: 2.1 time: 0.041299 Aug 01 15:25:58.038462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 126/272] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:25:57 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:58.068393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:58.068987 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:58.075204 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.075654 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.076407 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.076826 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.090152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fad294cb-57be-4db3-9a79-6c724b9aa612 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:58.090942 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fad294cb-57be-4db3-9a79-6c724b9aa612 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:58.100951 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fad294cb-57be-4db3-9a79-6c724b9aa612 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.101999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fad294cb-57be-4db3-9a79-6c724b9aa612 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.102872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fad294cb-57be-4db3-9a79-6c724b9aa612 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.103295 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fad294cb-57be-4db3-9a79-6c724b9aa612 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.130710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fad294cb-57be-4db3-9a79-6c724b9aa612 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/ips" status: 200 len: 152 microversion: 2.20 time: 0.046287 Aug 01 15:25:58.140576 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 127/273] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 1 15:25:58 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:25:58.230459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-995052042", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "433246f6-ca42-465b-a24b-2446665fca6a"}], "security_groups": [{"name": "tempest-securitygroup--587416220"}], "key_name": "tempest-keypair-1562267991", "user_data": "}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:58.249085 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:58.263834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-592918c0-bb17-4b0b-a632-89d20eccfbc6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.199336 Aug 01 15:25:58.264410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 147/274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:58 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:58.345704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] validate_networks() for [('433246f6-ca42-465b-a24b-2446665fca6a', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:25:58.768858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:25:58.769273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:25:58.769806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:25:58.770213 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:25:58.770674 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:25:58.781696 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.782462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.783655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:58.784181 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:58.802519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for project a359662d2a444976af8b1b9cc351edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:25:58.806369 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Getting quotas for user 6f852249c66a4f8986d7a63a957ec91c and project a359662d2a444976af8b1b9cc351edb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:25:58.808608 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:58.819325 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:25:58.821451 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:25:58.872819 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-849c6834-3ded-4373-9f56-b2b38adb7b2a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.646215 Aug 01 15:25:58.876680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 128/275] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:25:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:25:58.895640 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dc2ef911-cc23-4453-9c72-81867037c9a5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:58.897170 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dc2ef911-cc23-4453-9c72-81867037c9a5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:58.969909 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dc2ef911-cc23-4453-9c72-81867037c9a5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:58.978856 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dc2ef911-cc23-4453-9c72-81867037c9a5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1245 microversion: 2.1 time: 0.090761 Aug 01 15:25:58.979677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 148/276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:58 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:59.285094 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:59.285803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:59.292730 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.293171 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:59.293953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:59.294375 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:59.439053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:59.447672 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bad1eaa9-abf0-41ee-b251-113ffb834c60 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.166955 Aug 01 15:25:59.448243 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 129/277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:59 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:00.001216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:00.002228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:00.009857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:00.010314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:00.011081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:00.011634 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:00.080472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:00.088808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf1d3e68-2f74-4c1c-8700-deb19f7a01bf tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1241 microversion: 2.1 time: 0.091879 Aug 01 15:26:00.089363 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 149/278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:59 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:00.470331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:00.471214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:00.479111 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:00.479661 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:00.480441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:00.480870 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:00.502690 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:00.663716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:00.671675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-58ff53d4-74e1-4434-8945-33ca31ff3d03 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.206138 Aug 01 15:26:00.672207 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 130/279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:00 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:01.112216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:01.113018 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:01.121313 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.121969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.122860 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.123564 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.190994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:01.199157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-324727b8-031d-44c5-b832-52db169d4d5b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1303 microversion: 2.1 time: 0.090798 Aug 01 15:26:01.199727 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 150/280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:01 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:01.699585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:01.701101 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:01.735666 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.736482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.738122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:01.738594 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.738989 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:01.739392 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.761866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.765012 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.768799 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:01.769249 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:01.820924 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lazy-loading 'flavor' on Instance uuid 7b57efc3-5810-4f01-9863-c16ab9dba00f {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:26:02.173558 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-553c4e79-ae23-49c6-8998-b7ca848e06f2 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/action" status: 202 len: 0 microversion: 2.20 time: 0.442701 Aug 01 15:26:02.178553 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 151/281] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 15:26:01 2022] POST /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:26:02.186199 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:02.199227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:02.208114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:02.208884 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:02.210013 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:02.210728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:02.236587 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:02.363403 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:02.371463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84a6b38f-6aae-434e-961e-cca1c588ab9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.682251 Aug 01 15:26:02.385614 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 131/282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:01 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:02.391739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:02.393083 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:02.406399 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:02.407068 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:02.407990 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:02.408681 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:02.541550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:02.563414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:02.566125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:02.568540 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09a1f183-12a3-43bc-ba0e-d3a4c3389e3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.387980 Aug 01 15:26:02.582998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 152/283] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:02 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:02.597845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-5c3a227f-75a7-4516-9dfd-e4315f2c868b req-7d80da6a-348d-4aa5-966a-6c3f69106aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e", "name": "network-vif-plugged", "status": "completed", "tag": "c68be1f7-d774-45ae-ae98-631e16953453"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:02.610604 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5c3a227f-75a7-4516-9dfd-e4315f2c868b req-7d80da6a-348d-4aa5-966a-6c3f69106aa9 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:02.611052 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5c3a227f-75a7-4516-9dfd-e4315f2c868b req-7d80da6a-348d-4aa5-966a-6c3f69106aa9 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:02.624326 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-5c3a227f-75a7-4516-9dfd-e4315f2c868b req-7d80da6a-348d-4aa5-966a-6c3f69106aa9 service nova] Creating event network-vif-plugged:c68be1f7-d774-45ae-ae98-631e16953453 for instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e on hv-cinder-84713 Aug 01 15:26:02.630026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-5c3a227f-75a7-4516-9dfd-e4315f2c868b req-7d80da6a-348d-4aa5-966a-6c3f69106aa9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045223 Aug 01 15:26:02.630677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 153/284] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:02.663726 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:02.681351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-32280c0a-451a-4d87-aa3f-470c658d1c65 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.286658 Aug 01 15:26:02.681351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 132/285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:02 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:02.719901 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-f88dc998-da65-4a42-81f6-75c81b0d0c38 req-d66a4d58-5b3a-4d6a-8f90-2f95addcf89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07157dfb-c02b-4928-9053-f93eed2ef8ef", "tag": "b896bca9-acf1-4e03-aed9-a817f5160dab"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:02.730579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f88dc998-da65-4a42-81f6-75c81b0d0c38 req-d66a4d58-5b3a-4d6a-8f90-2f95addcf89b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:02.730959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f88dc998-da65-4a42-81f6-75c81b0d0c38 req-d66a4d58-5b3a-4d6a-8f90-2f95addcf89b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:02.744517 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-f88dc998-da65-4a42-81f6-75c81b0d0c38 req-d66a4d58-5b3a-4d6a-8f90-2f95addcf89b service nova] Creating event network-changed:b896bca9-acf1-4e03-aed9-a817f5160dab for instance 07157dfb-c02b-4928-9053-f93eed2ef8ef on hv-cinder-84713 Aug 01 15:26:02.749603 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-f88dc998-da65-4a42-81f6-75c81b0d0c38 req-d66a4d58-5b3a-4d6a-8f90-2f95addcf89b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035051 Aug 01 15:26:02.750239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 154/286] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:02.995600 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2edbc845-3ee8-4825-a301-a063931ac085 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa135bc-fe60-4db3-b2d0-b9f84a51f1bd"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:02.998982 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2edbc845-3ee8-4825-a301-a063931ac085 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:03.006920 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2edbc845-3ee8-4825-a301-a063931ac085 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.007381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2edbc845-3ee8-4825-a301-a063931ac085 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.008177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2edbc845-3ee8-4825-a301-a063931ac085 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.008616 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2edbc845-3ee8-4825-a301-a063931ac085 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.315574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2edbc845-3ee8-4825-a301-a063931ac085 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324005 Aug 01 15:26:03.316253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 133/287] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:26:02 2022] POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:03.397479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:03.398331 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:03.407872 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.408324 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.409525 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.409699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.471285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9119eba0-eb09-4bdc-98d4-939cfe4a9859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:03.472437 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9119eba0-eb09-4bdc-98d4-939cfe4a9859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:03.481761 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9119eba0-eb09-4bdc-98d4-939cfe4a9859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.482732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9119eba0-eb09-4bdc-98d4-939cfe4a9859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.483685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9119eba0-eb09-4bdc-98d4-939cfe4a9859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.484315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9119eba0-eb09-4bdc-98d4-939cfe4a9859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.517115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9119eba0-eb09-4bdc-98d4-939cfe4a9859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/ips" status: 200 len: 150 microversion: 2.1 time: 0.052480 Aug 01 15:26:03.517760 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 134/288] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:26:03 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:03.602267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:03.603400 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:03.611619 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.612067 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.613181 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.613877 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.659999 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:03.667827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d0ab941-9dad-4659-8f8f-ebb64e4bebb0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.276385 Aug 01 15:26:03.682256 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 155/289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:03 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:03.696460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:03.697334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:03.703970 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.704413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.705176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:03.705599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:03.808135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:03.817287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:03.818906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:03.820071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a9909ee4-dc94-4b95-b20a-c30c21820603 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.223241 Aug 01 15:26:03.834316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 135/290] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:03 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:03.874183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:03.885167 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4036883-1be5-4385-b93f-848cd55ae94f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.192818 Aug 01 15:26:03.885896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 156/291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:03 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:04.688943 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:04.689535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:04.696670 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:04.697120 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:04.697905 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:04.698360 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:04.842428 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:04.845540 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:04.846780 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:04.851956 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fa3fbf85-75ea-47cd-9e85-8c68afc15325 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.166937 Aug 01 15:26:04.852609 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 136/292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:04 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:04.865837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:04.865837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:04.865837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:04.865837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:04.907030 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:04.908184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:04.915111 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:04.915564 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:04.916338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:04.916904 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:05.044171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:05.052667 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:05.054200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:05.055364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd01512c-28eb-427c-82c8-cfba67ced2fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.214495 Aug 01 15:26:05.055948 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 157/293] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:04 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:05.060507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9155240-2034-49c6-8a5f-2ca424e20ce2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9057c6ee-136b-4447-9eb4-f4d5863bbe97"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:05.062957 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9155240-2034-49c6-8a5f-2ca424e20ce2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:05.069525 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9155240-2034-49c6-8a5f-2ca424e20ce2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:05.070015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9155240-2034-49c6-8a5f-2ca424e20ce2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:05.070792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9155240-2034-49c6-8a5f-2ca424e20ce2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:05.071566 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9155240-2034-49c6-8a5f-2ca424e20ce2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:05.096015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:05.103606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-395a2ec2-0d52-482b-a2f5-1342c4412e30 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.200800 Aug 01 15:26:05.104165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 137/294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:04 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:05.873919 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:05.874701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:05.882813 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:05.883364 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:05.884174 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:05.884606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:06.023825 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:06.031460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c435d8e9-0e8a-4671-9fd8-e2fbe980d6fa tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.161618 Aug 01 15:26:06.032014 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 138/295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:05 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:06.078428 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:06.079038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:06.085309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:06.085765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:06.086963 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:06.087991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:06.238917 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:06.248943 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:06.251039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:06.252771 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ea11cadf-c65f-4a64-8038-127da390fcb1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.177994 Aug 01 15:26:06.253365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 139/296] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:06 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:06.257986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:06.258590 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:06.264652 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:06.265097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:06.266057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:06.266315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:06.402970 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:06.410684 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7dce6850-1adc-457d-a632-3f705dbc18fd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.156347 Aug 01 15:26:06.411295 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 140/297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:06 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:07.052902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:07.053533 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:07.060540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:07.060994 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:07.061751 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:07.062231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:07.207628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:07.216044 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ad9233c-e082-400f-8970-f920d7471cce tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1266 microversion: 2.1 time: 0.166920 Aug 01 15:26:07.216768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 141/298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:07 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:07.276025 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:07.276625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:07.283054 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:07.283514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:07.284506 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:07.284776 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:07.441181 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:07.451448 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:07.452926 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:07.454299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4de2aed1-f8cc-4e59-a92a-984ba32dc929 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.182325 Aug 01 15:26:07.454869 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 142/299] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:07 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:07.459379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:07.459972 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:07.470343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:07.471085 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:07.471538 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:07.472083 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:07.602683 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:07.611285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7409bc89-31a1-4d18-a8ee-dcdde05d9841 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.155346 Aug 01 15:26:07.612091 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 143/300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:07 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:08.243968 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:08.244628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:08.253668 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.254217 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.255212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.255648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.432482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:08.441386 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-95cc7d4f-2271-41e3-aafa-52f8a6adbca1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1452 microversion: 2.1 time: 0.201180 Aug 01 15:26:08.442255 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 144/301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:08 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:08.465501 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:08.466155 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:08.475938 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.476146 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.477089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.477757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.626424 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:08.635668 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-207cc659-ee1e-4709-afb3-6794690ac09d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1452 microversion: 2.1 time: 0.174862 Aug 01 15:26:08.636675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 145/302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:08 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:08.641561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:08.642489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:08.654309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.655149 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.656271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:08.657015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:08.664685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.792463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.814205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=10 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:08.976410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:09.094165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9155240-2034-49c6-8a5f-2ca424e20ce2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.030244 Aug 01 15:26:09.094165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 158/303] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:26:05 2022] POST /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments => generated 194 bytes in 4032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:09.094342 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:09.103315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:09.108607 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:09.109153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:09.110104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:09.113999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-930d8d37-621c-4cd9-b5a2-5037316465d0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.473138 Aug 01 15:26:09.116366 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 146/304] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:08 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:09.119314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:09.119823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:09.120933 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:09.121696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:09.283402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:09.291478 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2b9ff761-5bb3-4796-bf9c-9e27bcd83a1d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.201532 Aug 01 15:26:09.292063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 159/305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:09 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:10.142522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:10.143157 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:10.150286 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:10.150814 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:10.151532 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:10.151930 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:10.304042 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:10.313588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:10.315105 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:10.316219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:10.316736 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2aa6f9bb-6d09-49b0-8768-aa7198b69beb tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.178220 Aug 01 15:26:10.317279 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:10.317524 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 147/306] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:10 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:10.326138 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:10.326998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:10.327928 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:10.328607 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:10.508796 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:10.519744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-abe25bfe-4868-4ce5-92be-197f87f4a6a8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.210061 Aug 01 15:26:10.520546 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 160/307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:10 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:10.983040 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-3418950b-d454-4cd7-b9f5-18fb904d184b req-695ea13e-1721-4e0e-88fb-4d04c673a2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e", "tag": "c68be1f7-d774-45ae-ae98-631e16953453"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:10.995440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-3418950b-d454-4cd7-b9f5-18fb904d184b req-695ea13e-1721-4e0e-88fb-4d04c673a2d7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:10.996051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-3418950b-d454-4cd7-b9f5-18fb904d184b req-695ea13e-1721-4e0e-88fb-4d04c673a2d7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.010565 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-3418950b-d454-4cd7-b9f5-18fb904d184b req-695ea13e-1721-4e0e-88fb-4d04c673a2d7 service nova] Creating event network-changed:c68be1f7-d774-45ae-ae98-631e16953453 for instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e on hv-cinder-84713 Aug 01 15:26:11.015768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-3418950b-d454-4cd7-b9f5-18fb904d184b req-695ea13e-1721-4e0e-88fb-4d04c673a2d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036857 Aug 01 15:26:11.018858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 148/308] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:11.022135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ba8d66ac-a7f9-41dd-8ce3-92b3c3dc8ca8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:11.033259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba8d66ac-a7f9-41dd-8ce3-92b3c3dc8ca8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.034681 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba8d66ac-a7f9-41dd-8ce3-92b3c3dc8ca8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.159011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ba8d66ac-a7f9-41dd-8ce3-92b3c3dc8ca8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Going to try to stop instance {{(pid=117825) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 15:26:11.234823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ba8d66ac-a7f9-41dd-8ce3-92b3c3dc8ca8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action" status: 202 len: 0 microversion: 2.1 time: 0.220893 Aug 01 15:26:11.235831 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 161/309] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:26:11 2022] POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:26:11.246142 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:11.247456 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:11.257458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.258231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.260136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.262515 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.342960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:11.343765 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:11.354634 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.355095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.355887 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.357540 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.627403 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:11.637868 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e6a6dce1-22ef-498d-a078-b6e9ac1ba254 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.397663 Aug 01 15:26:11.638910 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 149/310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:11 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:11.644130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:11.644728 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:11.656253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.657611 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.658470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:11.659073 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:11.671393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:11.685605 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:11.697932 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:11.699436 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-965c1ae6-c46b-4b3b-9be7-07b4e54a890e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.361801 Aug 01 15:26:11.700518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 162/311] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:11 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:11.910467 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:11.922586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3fd5e446-c8c5-4685-91f8-cbac4e36dcef tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.282110 Aug 01 15:26:11.923817 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 150/312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:11 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:12.659749 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:12.660524 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:12.671982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:12.672453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:12.673217 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:12.673878 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:12.727509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:12.729597 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:12.736972 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:12.738409 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:12.739934 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:12.740576 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:12.855595 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:12.871690 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ef9eaa33-f770-4fc7-98f8-c285e4784169 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.216326 Aug 01 15:26:12.872914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 163/313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:12 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:12.896196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e8ad530a-d803-41da-9d1e-a08153a4d9f8 req-f97e09a4-64c2-443e-a774-765e067e5dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07157dfb-c02b-4928-9053-f93eed2ef8ef", "name": "network-vif-plugged", "status": "completed", "tag": "b896bca9-acf1-4e03-aed9-a817f5160dab"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:12.907690 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e8ad530a-d803-41da-9d1e-a08153a4d9f8 req-f97e09a4-64c2-443e-a774-765e067e5dee service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:12.908397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e8ad530a-d803-41da-9d1e-a08153a4d9f8 req-f97e09a4-64c2-443e-a774-765e067e5dee service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:12.921875 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e8ad530a-d803-41da-9d1e-a08153a4d9f8 req-f97e09a4-64c2-443e-a774-765e067e5dee service nova] Creating event network-vif-plugged:b896bca9-acf1-4e03-aed9-a817f5160dab for instance 07157dfb-c02b-4928-9053-f93eed2ef8ef on hv-cinder-84713 Aug 01 15:26:12.928754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e8ad530a-d803-41da-9d1e-a08153a4d9f8 req-f97e09a4-64c2-443e-a774-765e067e5dee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054080 Aug 01 15:26:12.929659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 164/314] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:12.947226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:12.949338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:12.950271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:12.960306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:12.962883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:12.963169 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:12.963943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:12.964906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-df9db4be-3e68-42d1-a7d1-758e700b5021 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.243567 Aug 01 15:26:12.965700 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:12.965948 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 151/315] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:12 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:12.966928 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.205119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:13.219627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b017555b-19d3-417c-b1ff-1ea9f9dff720 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.277451 Aug 01 15:26:13.220859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 165/316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:12 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:13.894733 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:13.895376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:13.902373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.902832 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.903605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.904036 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.988366 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:13.989075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:13.995949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.996635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:13.997411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:13.997867 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:14.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:14.123237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e77ca107-4838-4cbd-afd9-69424c3d21fa tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.232292 Aug 01 15:26:14.124423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 152/317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:13 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:14.195707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:14.206189 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:14.207959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:14.209415 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b186230c-9991-4f5b-bc2f-4a81cfa76e50 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.225276 Aug 01 15:26:14.214080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 166/318] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:13 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:14.242057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:14.242680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:14.250004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:14.250500 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:14.251337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:14.251996 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:14.416017 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:14.423809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c825fa90-7b66-4b0b-b85f-56ff48a6fd03 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1370 microversion: 2.1 time: 0.186069 Aug 01 15:26:14.424381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 153/319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:14 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:15.145228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:15.146650 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:15.152684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.153128 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.153912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.154340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.238492 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:15.239387 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:15.247092 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.247545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.248335 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.248801 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.306020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:15.314285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3e808d7-c148-4322-91de-5b7bc5832711 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.173367 Aug 01 15:26:15.326214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 167/320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:15 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:15.412222 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:15.420890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:15.422433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:15.423737 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a81cef11-4667-407c-b65e-e30ec53645fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.189740 Aug 01 15:26:15.424277 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 154/321] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:15 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:15.445218 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:15.446586 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:15.453437 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.453911 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.454670 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.455307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.488157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:15.700966 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:15.709637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d43e45fb-a6d4-4147-8e70-cfa8e062f5a7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1563 microversion: 2.1 time: 0.268138 Aug 01 15:26:15.710375 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 168/322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:15 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1563 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:15.731148 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cdd4824b-19a6-4d1e-86a8-8194a96f5869 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:15.731648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cdd4824b-19a6-4d1e-86a8-8194a96f5869 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:15.746101 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdd4824b-19a6-4d1e-86a8-8194a96f5869 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.747526 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdd4824b-19a6-4d1e-86a8-8194a96f5869 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.756499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdd4824b-19a6-4d1e-86a8-8194a96f5869 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:15.757328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cdd4824b-19a6-4d1e-86a8-8194a96f5869 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:15.854621 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cdd4824b-19a6-4d1e-86a8-8194a96f5869 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127526 Aug 01 15:26:15.855265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 155/323] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:26:15 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:16.337801 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:16.338516 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:16.357556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:16.358444 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:16.360422 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:16.361210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:16.448388 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:16.449028 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:16.456798 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:16.457486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:16.458349 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:16.458976 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:16.678917 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:16.694942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8953786c-0682-40ae-8a94-b4d3717a67a0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.361630 Aug 01 15:26:16.695521 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 169/324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:16 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:16.759837 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:16.769510 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:16.771365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:16.772791 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d489c570-37f3-401c-9c36-14664df3506e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.329116 Aug 01 15:26:16.773947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 156/325] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:16 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:17.120862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-53cfd6ef-7de8-4537-b8d1-45ee4371e110 req-1d0bbbbe-5ce9-4b0a-9894-e9f0a2b77b28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07157dfb-c02b-4928-9053-f93eed2ef8ef", "tag": "b896bca9-acf1-4e03-aed9-a817f5160dab"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:17.137847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-53cfd6ef-7de8-4537-b8d1-45ee4371e110 req-1d0bbbbe-5ce9-4b0a-9894-e9f0a2b77b28 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.138292 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-53cfd6ef-7de8-4537-b8d1-45ee4371e110 req-1d0bbbbe-5ce9-4b0a-9894-e9f0a2b77b28 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:17.154265 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-53cfd6ef-7de8-4537-b8d1-45ee4371e110 req-1d0bbbbe-5ce9-4b0a-9894-e9f0a2b77b28 service nova] Creating event network-changed:b896bca9-acf1-4e03-aed9-a817f5160dab for instance 07157dfb-c02b-4928-9053-f93eed2ef8ef on hv-cinder-84713 Aug 01 15:26:17.160687 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-53cfd6ef-7de8-4537-b8d1-45ee4371e110 req-1d0bbbbe-5ce9-4b0a-9894-e9f0a2b77b28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045415 Aug 01 15:26:17.161636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 170/326] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:26:17.722509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:17.723278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:17.731059 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.731599 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:17.732511 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.733138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:17.800181 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:17.801305 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:17.808412 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.809257 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:17.810270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:17.810707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:18.490005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:18.498557 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:18.500348 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d9501064-e55d-4c7d-9ab7-6a01539d792e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.782071 Aug 01 15:26:18.501821 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 157/327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:17 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:18.507699 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-41d58440-6259-446f-9490-a1114b3e882b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: .version_select at 0x7f03675fd820>, body: {"keypair": {"name": "tempest-keypair-1527833541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfcBopI2TKlSFgI5wx0SvzsqidarcIMTduRsvdu2J3oUPcxbfRLdVm4DwoOArdRl3bGhTzzLKR+kUYCgNu7B+IuVoruqcNxSYcCBxOokH8VN7kqr5uBxu9nPTndNRVf0Q=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:18.514989 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:18.516613 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:18.517936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f73865f-5200-4c60-a33a-f28f1c1e54ca tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.724091 Aug 01 15:26:18.518518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 171/328] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:17 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:18.541734 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-41d58440-6259-446f-9490-a1114b3e882b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:26:18.545974 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-41d58440-6259-446f-9490-a1114b3e882b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:26:18.578089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-41d58440-6259-446f-9490-a1114b3e882b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073641 Aug 01 15:26:18.579650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 158/329] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:26:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:19.524890 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:19.526199 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:19.534299 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:19.534778 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:19.535729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:19.536346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:19.546235 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:19.547748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:19.560665 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:19.561371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:19.562204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:19.562772 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:19.780047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:19.788794 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9693346a-47fa-43f4-99be-90cba26e837d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.268127 Aug 01 15:26:19.789367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 172/330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:19 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:19.840281 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:19.851665 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:19.853937 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:19.855188 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78b3503b-8729-4e75-bdbc-d0530fd6d6e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.315970 Aug 01 15:26:19.855938 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 159/331] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:19 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:20.215563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1304981033", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7ed53a-69a3-4296-8374-cca80fe55475"}], "security_groups": [{"name": "tempest-securitygroup--1361596998"}], "key_name": "tempest-keypair-1527833541", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:20.331228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] validate_networks() for [('9b7ed53a-69a3-4296-8374-cca80fe55475', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:26:20.738807 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:26:20.739380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:26:20.739686 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:26:20.740092 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:26:20.740498 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:26:20.751154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:20.751601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:20.752398 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:20.752822 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:20.769730 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:26:20.774205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:26:20.787605 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:26:20.789957 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:26:20.815469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:20.816612 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:20.828018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:20.828699 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:20.829959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:20.836512 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:20.849021 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df3a12ea-a7fb-4c0c-8a28-ced23cdc51c4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.638216 Aug 01 15:26:20.855965 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 173/332] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:26:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:26:20.879597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e659518c-6bac-4d79-9a81-40121eadde0f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:20.881896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e659518c-6bac-4d79-9a81-40121eadde0f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:20.969135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e659518c-6bac-4d79-9a81-40121eadde0f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:20.984324 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e659518c-6bac-4d79-9a81-40121eadde0f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1242 microversion: 2.1 time: 0.113680 Aug 01 15:26:20.984996 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 174/333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:20 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:20.993119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:20.993119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:21.006600 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:21.007234 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:21.008185 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:21.008708 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:21.045655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:21.057318 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3bcd6262-ef74-4a01-b1e6-9de4c7b388f3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.247004 Aug 01 15:26:21.058085 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 160/334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:20 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:21.193090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:21.207187 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:21.209065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:21.210525 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a251debc-3862-420e-930e-5e4ba893d040 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.223590 Aug 01 15:26:21.211466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 175/335] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:20 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:22.006224 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:22.007009 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:22.014766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.015218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.015993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.016433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.079515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:22.080123 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:22.087491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.087993 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.089817 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.090224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.091598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:22.099735 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-497b2c66-8b38-475e-8aa9-f4cb56045e69 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1294 microversion: 2.1 time: 0.097622 Aug 01 15:26:22.100314 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 161/336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:22 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:22.235688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:22.236323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:22.242623 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.243332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.244939 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:22.245359 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:22.254019 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:22.263566 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aa6c7fdf-79e6-4e42-a7d1-f26dcb892e48 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.188166 Aug 01 15:26:22.264485 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 176/337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:22 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:22.457568 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:22.466484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:22.467991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:22.469143 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a0fcbf72-ae8e-4b5f-b20f-694c1b990420 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.238663 Aug 01 15:26:22.469700 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 162/338] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:22 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:23.122176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:23.122847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:23.132443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.133025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.133925 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.134402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.287559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:23.288174 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:23.299801 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.300245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.301158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.301452 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.513154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:23.527004 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-78b8b839-dc71-46f8-ad02-fcff232fd650 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.407155 Aug 01 15:26:23.541519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 177/339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:23 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:23.549518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:23.550542 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:23.552921 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:23.574369 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.575507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.576923 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:23.577477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:23.644079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:23.654530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45bdb9b1-822e-4f72-bf9c-9673231aad2f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.372287 Aug 01 15:26:23.655428 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 163/340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:23 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:23.885044 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:23.897803 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:23.900608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:23.913456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4cff325d-2ea8-4298-9550-0957e35eca2c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1745 microversion: 2.20 time: 0.373014 Aug 01 15:26:23.913456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 178/341] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:23 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1745 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:24.208127 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-b0c3bfea-ecfb-4af9-b863-6eb24e2d5aad req-646ed012-d760-4361-a1ef-e48616f328b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721bdce3-df3b-4543-8e84-eb63f3da2b7f", "tag": "aeb89320-34be-4079-be8e-e76a7a04bdc2"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:24.221969 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b0c3bfea-ecfb-4af9-b863-6eb24e2d5aad req-646ed012-d760-4361-a1ef-e48616f328b0 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:24.222933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-b0c3bfea-ecfb-4af9-b863-6eb24e2d5aad req-646ed012-d760-4361-a1ef-e48616f328b0 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:24.247940 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-b0c3bfea-ecfb-4af9-b863-6eb24e2d5aad req-646ed012-d760-4361-a1ef-e48616f328b0 service nova] Creating event network-changed:aeb89320-34be-4079-be8e-e76a7a04bdc2 for instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f on hv-cinder-84713 Aug 01 15:26:24.254129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-b0c3bfea-ecfb-4af9-b863-6eb24e2d5aad req-646ed012-d760-4361-a1ef-e48616f328b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051980 Aug 01 15:26:24.255751 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 164/342] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:24.549082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:24.549754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:24.556069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:24.556429 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:24.557871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:24.558308 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:24.677128 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:24.677951 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:24.687576 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:24.688066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:24.690099 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:24.690907 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:24.717685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:24.855837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:24.908342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-413adbb1-fc33-4d27-84ff-d196b5c52356 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.362882 Aug 01 15:26:24.922153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:24.927606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23d96517-c1e9-44f7-813f-9d5136559ffd tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.254359 Aug 01 15:26:24.929207 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 165/343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:24 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:24.930173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 179/344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:24 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:24.949768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:24.950427 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:24.957389 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:24.957812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:24.958775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:24.959351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:25.114952 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:25.124740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:25.126744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:25.128181 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bfe0a00f-a72b-4cbc-b98e-f2e3c969c24e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1745 microversion: 2.20 time: 0.195178 Aug 01 15:26:25.129023 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 166/345] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:24 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:25.944907 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:25.944907 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:25.950825 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:25.951484 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:25.951600 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:25.951698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:25.952556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:25.953878 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:25.959062 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:25.959570 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:25.960315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:25.961394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:26.175448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:26.178033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:26.186523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-04d72fa0-5941-497d-b708-b40b6627097c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.239722 Aug 01 15:26:26.186713 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-589a5783-8d73-4323-98ec-6ccbec79feeb tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.247864 Aug 01 15:26:26.187090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 167/346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:25 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:26.187199 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 180/347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:25 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:26.197550 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:26.198469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:26.205749 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:26.206291 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:26.207183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:26.207849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:26.351938 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:26.360504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:26.362094 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:26.363232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f947a8d-ad6c-40fa-b06f-c3d406f3b1fd tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1745 microversion: 2.20 time: 0.172459 Aug 01 15:26:26.363788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 168/348] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:26 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:26.766854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-acfe6765-b1be-4a09-82ea-51f55f445994 req-52bf777b-c2b8-4e15-a004-95df2919efc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b57efc3-5810-4f01-9863-c16ab9dba00f", "name": "network-vif-plugged", "status": "completed", "tag": "1fafaa48-a913-4b85-9a2b-22a5748ea906"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:26.785391 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-acfe6765-b1be-4a09-82ea-51f55f445994 req-52bf777b-c2b8-4e15-a004-95df2919efc4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:26.786009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-acfe6765-b1be-4a09-82ea-51f55f445994 req-52bf777b-c2b8-4e15-a004-95df2919efc4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:26.813864 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-acfe6765-b1be-4a09-82ea-51f55f445994 req-52bf777b-c2b8-4e15-a004-95df2919efc4 service nova] Creating event network-vif-plugged:1fafaa48-a913-4b85-9a2b-22a5748ea906 for instance 7b57efc3-5810-4f01-9863-c16ab9dba00f on hv-cinder-84713 Aug 01 15:26:26.819093 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-acfe6765-b1be-4a09-82ea-51f55f445994 req-52bf777b-c2b8-4e15-a004-95df2919efc4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055945 Aug 01 15:26:26.820040 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 181/349] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:27.207520 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:27.208502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:27.215579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:27.216179 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:27.216605 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:27.217056 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:27.217871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:27.218300 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:27.226082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:27.226533 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:27.227279 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:27.227714 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:27.722529 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:27.733739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-958009cb-c120-4de2-9089-9465330cfdbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.530338 Aug 01 15:26:27.734429 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:27.735054 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 169/350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:27 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:27.742464 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:27.743494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:27.744036 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e9210648-8544-469b-a09f-2e2ec7ef10e4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.540523 Aug 01 15:26:27.747030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 182/351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:27 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:27.763477 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:27.767950 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:27.769051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:27.770156 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:27.770932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:27.961576 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:27.971815 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:27.972974 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:27.974732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d615409d-9394-4bd4-8b18-9ac52f5750a1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.238164 Aug 01 15:26:27.975476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 170/352] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:27 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:28.792486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:28.794735 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:28.797772 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:28.799638 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:28.801425 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:28.809180 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:28.810615 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:28.811859 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:28.812618 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:28.815756 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:28.816920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:28.821212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:28.825171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:29.099780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:29.113360 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ba6cbaba-237b-44b2-a213-c7fa4e6e33a1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.325149 Aug 01 15:26:29.114812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 171/353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:28 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:29.123984 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:29.124596 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:29.131123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:29.131572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:29.132356 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:29.132781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:29.135691 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:29.146767 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1520956-169a-45e2-b97c-304cdb1b6d2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.355074 Aug 01 15:26:29.147351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 183/354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:28 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:29.318763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:29.327793 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:29.329732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:29.331237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c0e465e1-d661-4f50-85ca-fa30e7b9482e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.215154 Aug 01 15:26:29.350482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 172/355] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:29 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:30.135757 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:30.136455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:30.145800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:30.146351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:30.147229 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:30.147732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:30.169276 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:30.170016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:30.178730 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:30.179502 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:30.180477 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:30.181097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:30.396606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:30.409344 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2da7e7f1-f7e6-47cb-8e8a-dc8500280ef5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.277544 Aug 01 15:26:30.415081 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:30.424805 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 184/356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:30 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:30.427343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-728529cb-42d8-4473-974e-e2ee355bf56c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.262792 Aug 01 15:26:30.430834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:30.431664 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:30.439275 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:30.439972 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:30.440924 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:30.441152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 173/357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:30 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:30.441714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:30.617644 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:30.626575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:30.628727 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:30.630095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-69e70805-d3d6-47b0-a9e6-fee0439be82a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.203887 Aug 01 15:26:30.630735 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 185/358] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:30 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:30.826215 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-a6ea9926-f590-4bc1-87d1-22943911cf5e req-ad5c269e-8eca-489f-8345-62014efb7054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721bdce3-df3b-4543-8e84-eb63f3da2b7f", "name": "network-vif-plugged", "status": "completed", "tag": "aeb89320-34be-4079-be8e-e76a7a04bdc2"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:30.837647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-a6ea9926-f590-4bc1-87d1-22943911cf5e req-ad5c269e-8eca-489f-8345-62014efb7054 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:30.838428 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-a6ea9926-f590-4bc1-87d1-22943911cf5e req-ad5c269e-8eca-489f-8345-62014efb7054 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:30.877384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-a6ea9926-f590-4bc1-87d1-22943911cf5e req-ad5c269e-8eca-489f-8345-62014efb7054 service nova] Creating event network-vif-plugged:aeb89320-34be-4079-be8e-e76a7a04bdc2 for instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f on hv-cinder-84713 Aug 01 15:26:30.919112 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-a6ea9926-f590-4bc1-87d1-22943911cf5e req-ad5c269e-8eca-489f-8345-62014efb7054 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097779 Aug 01 15:26:30.920037 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 174/359] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:26:31.435585 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:31.445132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:31.451586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:31.453071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:31.457516 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.461730 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=8 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:31.465078 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:31.465535 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:31.467704 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:31.467929 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:31.468153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:31.468704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:31.469665 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:31.470272 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:31.735307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:31.745932 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6b37fe93-57e1-4794-8ebf-46f62cb1746c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1726 microversion: 2.1 time: 0.318326 Aug 01 15:26:31.747257 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 186/360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:31 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1726 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:31.756310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:31.757601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:31.769880 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:31.774610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:31.775599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:31.776678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:31.777125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:31.788368 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c910cc6a-ccf0-42c3-b1a1-dd40347b91a3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.341350 Aug 01 15:26:31.789262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 175/361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:31 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:31.961201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:31.970765 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:31.972614 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:31.973804 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5fce6e78-fbed-4b4b-bcbb-81f790831a0e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.225181 Aug 01 15:26:31.986559 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 187/362] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:31 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:32.770109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:32.771261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:32.779029 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:32.779647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:32.780519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:32.780966 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:32.811649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:32.812926 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:32.828154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:32.828857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:32.829844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:32.830428 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:32.847352 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:33.046547 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:33.054964 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-294ae164-fcfd-4833-bd6a-a7eb272e41f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1368 microversion: 2.1 time: 0.247154 Aug 01 15:26:33.071285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:33.071882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 188/363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:32 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:33.077534 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:33.078403 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:33.078537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-288655ba-409e-4e69-ae52-0eeeac24eb94 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1703 microversion: 2.1 time: 0.312171 Aug 01 15:26:33.079625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 176/364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:32 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1703 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:33.085218 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:33.085676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:33.086824 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:33.087263 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:33.108499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ffb3172a-e16f-4fb5-b9a4-ddb041eb5de0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:33.123540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffb3172a-e16f-4fb5-b9a4-ddb041eb5de0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:33.126371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ffb3172a-e16f-4fb5-b9a4-ddb041eb5de0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:33.229248 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ffb3172a-e16f-4fb5-b9a4-ddb041eb5de0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Going to try to start instance {{(pid=117824) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 15:26:33.266193 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:33.278689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:33.280181 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:33.281360 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-32acc6fc-5fa8-4f3a-a877-1ea8633f784c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.208174 Aug 01 15:26:33.285959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 189/365] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:33 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:33.300260 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ffb3172a-e16f-4fb5-b9a4-ddb041eb5de0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action" status: 202 len: 0 microversion: 2.1 time: 0.200763 Aug 01 15:26:33.309410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:33.310412 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:33.312534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 177/366] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:26:33 2022] POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:26:33.318958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:33.319843 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:33.320738 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:33.321142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:33.518905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:33.533925 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-871ea57e-3e37-4dab-b732-499a6b4d5ae5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1712 microversion: 2.1 time: 0.228415 Aug 01 15:26:33.554815 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 190/367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:33 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1712 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:34.077444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:34.078779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:34.087533 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.088132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.089022 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.089531 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.308312 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:34.308990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:34.316992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.319649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.320759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.321374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.610759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:34.620752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d6f8b81c-fe90-4759-a905-0dc8976f5969 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1557 microversion: 2.1 time: 0.548067 Aug 01 15:26:34.621499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 178/368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:34 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1557 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:34.636561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:34.637836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:34.648221 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:34.650200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.651024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.652436 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.653264 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.667582 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:34.675573 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:34.676948 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-42fa8b60-7df4-4326-acc1-60906f47a56a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.376325 Aug 01 15:26:34.690903 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 191/369] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:34 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:34.702732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a502bf24-58b6-45b2-92c3-332887e7e7fe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:34.703245 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a502bf24-58b6-45b2-92c3-332887e7e7fe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:34.711150 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a502bf24-58b6-45b2-92c3-332887e7e7fe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.711606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a502bf24-58b6-45b2-92c3-332887e7e7fe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.712372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a502bf24-58b6-45b2-92c3-332887e7e7fe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:34.713023 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a502bf24-58b6-45b2-92c3-332887e7e7fe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:34.831853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a502bf24-58b6-45b2-92c3-332887e7e7fe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139410 Aug 01 15:26:34.832806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 192/370] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:26:34 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:34.887319 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:34.899718 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a91c808d-c070-437f-a048-6515f97bfd57 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1712 microversion: 2.1 time: 0.276876 Aug 01 15:26:34.900451 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 179/371] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:34 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1712 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:35.705669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:35.706327 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:35.717526 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:35.717914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:35.718700 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:35.719131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:35.924164 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:35.924765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:35.930196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:35.933808 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:35.934264 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:35.935042 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:35.935472 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:35.943330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:35.945339 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:35.946757 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05c6e7ae-d123-496b-843e-e284442fce24 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.247475 Aug 01 15:26:35.958024 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 193/372] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:35 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:36.173592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:36.189679 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3853a96a-40a3-48ba-bf1a-c7043c19b4b1 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1716 microversion: 2.1 time: 0.269491 Aug 01 15:26:36.194527 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 180/373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:26:35 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1716 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:26:36.286285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e1c1c57f-3eb7-488d-a5d0-cc20371b91f0 req-f8186208-ef27-4473-879a-7ca62ed30be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721bdce3-df3b-4543-8e84-eb63f3da2b7f", "tag": "aeb89320-34be-4079-be8e-e76a7a04bdc2"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:36.298295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e1c1c57f-3eb7-488d-a5d0-cc20371b91f0 req-f8186208-ef27-4473-879a-7ca62ed30be6 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:36.298807 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e1c1c57f-3eb7-488d-a5d0-cc20371b91f0 req-f8186208-ef27-4473-879a-7ca62ed30be6 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:36.318312 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e1c1c57f-3eb7-488d-a5d0-cc20371b91f0 req-f8186208-ef27-4473-879a-7ca62ed30be6 service nova] Creating event network-changed:aeb89320-34be-4079-be8e-e76a7a04bdc2 for instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f on hv-cinder-84713 Aug 01 15:26:36.328859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e1c1c57f-3eb7-488d-a5d0-cc20371b91f0 req-f8186208-ef27-4473-879a-7ca62ed30be6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049166 Aug 01 15:26:36.330446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 194/374] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:26:36.971482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:36.972932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:36.985486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:36.986325 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:36.987309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:36.988146 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:37.287701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:37.290970 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:37.310639 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:37.318335 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:37.322147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9804f232-b37b-402f-aaf6-bd5b57d5c1f3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.354524 Aug 01 15:26:37.324269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 181/375] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:36 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:38.358682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:38.360710 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:38.367991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:38.368515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:38.369383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:38.369817 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:38.586571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:38.596116 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:38.597721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:38.599659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df744cb7-efd4-4e7e-acaa-d9cfcc106ab1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.246603 Aug 01 15:26:38.599881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 195/376] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:38 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:26:39.637490 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:39.638129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:39.644977 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:39.645416 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:39.646233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:39.646652 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:39.789362 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:39.802043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:39.804314 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:39.806209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4fe1d55b-ea0e-44bc-bada-93713bed5b26 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.173075 Aug 01 15:26:39.806928 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 182/377] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:39 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:40.830793 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:40.831671 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:40.839370 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:40.839667 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:40.840447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:40.840874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:40.985123 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:40.997397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:40.998992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:41.000150 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc7f9553-7440-4a3d-b7fa-d1d0c7a5e615 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.173867 Aug 01 15:26:41.000721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 196/378] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:40 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:42.026327 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:42.026911 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:42.034167 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:42.034624 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:42.035381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:42.035809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:42.186030 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:42.196493 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:42.198066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:42.199289 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-70221650-6dfb-418e-ab6f-330a1b266c2f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1740 microversion: 2.20 time: 0.176998 Aug 01 15:26:42.199839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 183/379] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:42 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:43.224214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:43.224870 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:43.232221 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:43.232685 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:43.233538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:43.234022 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:43.385057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:43.393386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:43.394949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:43.396120 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-957269ab-00c5-45b2-bf80-c3ba9978c727 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1722 microversion: 2.20 time: 0.176911 Aug 01 15:26:43.396679 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 197/380] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:43 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:44.423518 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:44.424139 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:44.434043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:44.434517 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:44.435286 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:44.435719 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:44.573285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:44.586359 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:44.588845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:44.590155 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a64fa1f-a4eb-49b5-b148-11f2df16685e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1722 microversion: 2.20 time: 0.173450 Aug 01 15:26:44.590672 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 184/381] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:44 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:45.613512 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:45.614200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:45.620811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:45.621290 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:45.622102 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:45.622533 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:45.835994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:45.846916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:45.849214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:45.850945 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13aaee28-08a4-48c6-bb72-836894253325 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1722 microversion: 2.20 time: 0.241311 Aug 01 15:26:45.851622 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 198/382] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:45 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:46.874552 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:46.875152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:46.882115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:46.882555 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:46.883315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:46.883739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:47.044597 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:47.052894 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:47.054423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:47.055585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e284b1d4-9635-4ad6-85f6-0452826a25e5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1722 microversion: 2.20 time: 0.185432 Aug 01 15:26:47.056152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 185/383] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:46 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:48.079004 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:48.079582 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:48.087215 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:48.087664 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:48.088434 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:48.088870 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:48.239460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:48.251070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:48.252579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:48.253731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ce05fe7f-b524-49a1-a00c-d7f32b877ce0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1722 microversion: 2.20 time: 0.178741 Aug 01 15:26:48.254784 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 199/384] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:48 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:49.277509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:49.278135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:49.285063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:49.285506 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:49.286312 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:49.286747 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:49.430084 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:49.440414 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:49.441932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:49.443105 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f0caf65d-46dc-422f-8f10-a387ccea791e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1722 microversion: 2.20 time: 0.169734 Aug 01 15:26:49.443873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 186/385] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:49 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:49.756142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-8467652d-37d9-4a2e-b2a1-694108472c59 req-10d7b4f1-41ba-40a4-93fd-86c683acc0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b57efc3-5810-4f01-9863-c16ab9dba00f", "name": "network-vif-unplugged", "status": "completed", "tag": "1fafaa48-a913-4b85-9a2b-22a5748ea906"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:49.769969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8467652d-37d9-4a2e-b2a1-694108472c59 req-10d7b4f1-41ba-40a4-93fd-86c683acc0ec service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:49.770322 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8467652d-37d9-4a2e-b2a1-694108472c59 req-10d7b4f1-41ba-40a4-93fd-86c683acc0ec service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:49.782731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-8467652d-37d9-4a2e-b2a1-694108472c59 req-10d7b4f1-41ba-40a4-93fd-86c683acc0ec service nova] Creating event network-vif-unplugged:1fafaa48-a913-4b85-9a2b-22a5748ea906 for instance 7b57efc3-5810-4f01-9863-c16ab9dba00f on hv-cinder-84713 Aug 01 15:26:49.787980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-8467652d-37d9-4a2e-b2a1-694108472c59 req-10d7b4f1-41ba-40a4-93fd-86c683acc0ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038633 Aug 01 15:26:49.788581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 200/386] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:26:50.466334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:50.466949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:50.474472 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:50.474924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:50.475689 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:50.476121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:50.695875 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:50.708603 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:50.710988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:50.712418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-70b2420b-4c53-4c4c-abd0-b9f6237a817c tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1725 microversion: 2.20 time: 0.250029 Aug 01 15:26:50.731189 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 187/387] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:50 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:50.737862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0a391be2-d00b-432e-a397-f3693520ca60 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb028a05-b9e6-43f5-a9c4-d717070edb96"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:50.741025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0a391be2-d00b-432e-a397-f3693520ca60 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:50.747927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a391be2-d00b-432e-a397-f3693520ca60 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:50.748489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a391be2-d00b-432e-a397-f3693520ca60 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:50.749676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a391be2-d00b-432e-a397-f3693520ca60 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:50.749867 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a391be2-d00b-432e-a397-f3693520ca60 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:51.070665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0a391be2-d00b-432e-a397-f3693520ca60 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337430 Aug 01 15:26:51.071408 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 201/388] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 1 15:26:50 2022] POST /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:26:51.209958 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:26:51.211479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:51.218497 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:51.218936 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:51.219776 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:51.220200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:51.265865 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117824) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:26:51.346569 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-63159b58-9e37-43ca-99a0-69b4b1f5785d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/action" status: 202 len: 0 microversion: 2.20 time: 0.146399 Aug 01 15:26:51.347177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 188/389] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 15:26:51 2022] POST /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:26:51.355772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:51.356382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:51.362662 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:51.363096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:51.363869 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:51.364285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:51.500413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:51.509268 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:51.510876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:51.512004 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9302d902-9e9c-4fef-a885-44ec2cc4bbcc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1751 microversion: 2.20 time: 0.160379 Aug 01 15:26:51.512725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 202/390] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:51 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:52.539417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:52.540022 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:52.546673 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:52.547120 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:52.547967 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:52.548399 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:52.686262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:52.695033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:52.696535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:52.697694 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-43e72140-1bc4-4bf5-b967-da6bdefe2a18 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1751 microversion: 2.20 time: 0.162953 Aug 01 15:26:52.698284 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 189/391] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:52 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:53.722459 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:53.723167 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:53.726749 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=50 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:53.733222 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:53.733661 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:53.734703 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:53.735248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:53.873569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:53.877277 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:26:53.883688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:53.885308 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:53.886707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9550c89-89cb-4972-b408-e34dfa184bd8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1751 microversion: 2.20 time: 0.168737 Aug 01 15:26:53.887315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 203/392] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:53 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:54.912999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:54.913605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:54.920510 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:54.921138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:54.922361 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:54.922796 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:55.067099 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:55.076240 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:55.078538 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:55.079990 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1fdd9d22-282b-4949-9c24-bedf18be0ff8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1753 microversion: 2.20 time: 0.171237 Aug 01 15:26:55.080569 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 190/393] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:54 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:56.107178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:56.108014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:56.115836 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:56.116349 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:56.117112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:56.117549 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:56.329029 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:56.338521 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:56.340131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:56.341415 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e6941c00-512b-446e-a86c-3383c2078f15 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.240578 Aug 01 15:26:56.342398 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 204/394] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:56 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:57.366479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:57.367116 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:57.374109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:57.374805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:57.375798 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:57.376249 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:57.898255 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:57.911105 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:57.922858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:57.922858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1e1b1a5-dcef-4873-8def-5e90b419535f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.556671 Aug 01 15:26:57.922858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 191/395] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:57 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:26:58.941351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:26:58.941991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:26:58.948865 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:58.949302 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:58.950126 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:26:58.950536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:26:59.129876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:59.139466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:59.140873 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:26:59.142519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1ff1679c-b708-4f10-a583-80f567b5995e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.204959 Aug 01 15:26:59.143233 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 205/396] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:26:58 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:00.166839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:00.167522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:00.171344 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:00.175303 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:00.175746 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:00.176800 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:00.177231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:00.321973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:00.331940 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:00.334183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:00.335833 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-edf1612b-7349-4335-aa69-016db81a58c8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.173077 Aug 01 15:27:00.346637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 192/397] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:00 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:01.363965 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:01.365514 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:01.372679 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:01.373143 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:01.374032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:01.374635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:01.567760 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:01.576330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:01.577929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:01.579410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9770f8e2-71ff-4987-9202-f701a2d0b6ac tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.220580 Aug 01 15:27:01.580054 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 206/398] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:01 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:02.607033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:02.608836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:02.620048 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:02.621134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:02.622842 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:02.623605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:03.002381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:03.011090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:03.014876 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:03.018715 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2622a99a-50ef-4a40-91d2-cacb6c259c04 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.419001 Aug 01 15:27:03.019544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 193/399] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:02 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:04.045887 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:04.046523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:04.055487 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:04.055976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:04.056754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:04.057184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:04.353466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:04.363311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:04.371788 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:04.374139 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-665e97d5-6091-4e41-96e1-e08c4d04d5b1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.332048 Aug 01 15:27:04.375630 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 207/400] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:04 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:05.399084 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:05.401923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:05.417596 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:05.418441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:05.420853 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:05.422382 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:05.875039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:05.905910 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:05.911109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:05.912339 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2d31c75d-0182-4bdf-8700-680be5b583b6 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.519167 Aug 01 15:27:05.916187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 194/401] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:05 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:06.941449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:06.942261 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:06.949540 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:06.950147 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:06.951314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:06.952192 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:07.238027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:07.249793 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:07.251563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:07.255265 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-acc4323f-97cd-4559-8abd-5edcb12562c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.319220 Aug 01 15:27:07.257946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 208/402] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:06 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:08.281076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:08.281998 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:08.290531 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:08.291424 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:08.292423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:08.293516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:08.587106 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:08.602316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:08.604200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:08.605935 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-54c95993-4fcc-4e16-808c-3a41640aef94 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.328970 Aug 01 15:27:08.608083 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 195/403] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:08 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:09.637684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:09.638563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:09.659837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:09.660752 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:09.663070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:09.663751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:09.957761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:09.969673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:09.977022 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:09.990824 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd999f9b-67c4-4474-9663-8402fc2ad6be tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.355073 Aug 01 15:27:09.996058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 209/404] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:09 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:11.020064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:11.020803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:11.039275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:11.040012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:11.041732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:11.042394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:11.051494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:11.399622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:11.423661 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:11.427541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:11.430542 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25904b81-de21-41c0-90c1-c1ea4cd9ac4d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.414172 Aug 01 15:27:11.433131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 196/405] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:11 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:12.456304 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:12.457852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:12.471335 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:12.472081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:12.472839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:12.475237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:12.745105 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:12.758372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:12.760118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:12.761467 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b324fe7-3ef3-40ab-935f-002d1397ab90 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.309886 Aug 01 15:27:12.766853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 210/406] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:12 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:13.795963 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:13.797241 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:13.811670 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:13.813046 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:13.814018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:13.814536 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:14.006254 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:14.017770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:14.026732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:14.028030 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c69a6c63-2d6b-4d56-aa99-6fbb7d3ae3a5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.240591 Aug 01 15:27:14.028825 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 197/407] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:13 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:14.668053 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4951461e-7528-4c85-b04c-5932f2e79abd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Action: 'create', calling method: .version_select at 0x7f03675543a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1355361713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEb1slCpIBLa2zM8qdVt4grYY73t4U9ZPFlhSsiI/sqHoA6x4rZ99hvQQ0aBStRsQ74x6Z0NJvEHoDTTg2+94DHu+LKrZLgPpMlqEgFLgicTXqCF+2AgphVrzdOQSr6pA=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:14.683625 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-4951461e-7528-4c85-b04c-5932f2e79abd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Getting quotas for project 4ad998384c894fe9aed6d57f7aa1110b. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:27:14.688631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-4951461e-7528-4c85-b04c-5932f2e79abd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Getting quotas for user 30b9685e174a4523a6c36d4d0bebd5fc and project 4ad998384c894fe9aed6d57f7aa1110b. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:27:14.701186 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4951461e-7528-4c85-b04c-5932f2e79abd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [42ed9811-51a5-419e-b750-714bd0cf5661] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 15:27:15.057331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:15.058543 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:15.068414 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:15.069152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:15.070140 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:15.070713 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:15.220793 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:15.229701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:15.231236 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:15.232368 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-683022c7-6cd7-4c7f-99e6-6c61a84e6271 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.183450 Aug 01 15:27:15.232924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 198/408] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:15 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:15.711995 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1849588302", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "networks": [{"uuid": "6763ac8e-2b02-41c6-89a1-605e1a566a14"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:15.714725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [None req-4951461e-7528-4c85-b04c-5932f2e79abd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [42ed9811-51a5-419e-b750-714bd0cf5661] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 35080. Aug 01 15:27:15.732868 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4951461e-7528-4c85-b04c-5932f2e79abd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.261715 Aug 01 15:27:15.738451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 211/409] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:27:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:15.781212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] validate_networks() for [('6763ac8e-2b02-41c6-89a1-605e1a566a14', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:27:16.256044 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:16.257687 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:16.265617 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:16.266374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:16.267152 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:16.267636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:16.503397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:16.513284 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:16.514972 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:16.516632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6a1f9483-92fe-4dca-970e-713c2f95fa05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.264575 Aug 01 15:27:16.533439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 212/410] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:16 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:16.607388 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:27:16.607955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:27:16.608275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:27:16.608659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:27:16.609096 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:27:16.620147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:16.620701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:16.621496 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:16.622003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:16.641930 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Getting quotas for project dc512d8e2ab848fda424f9eeb6c816c9. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:27:16.647287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Getting quotas for user b1afe2bda6784f9987b8aa5fa174dde2 and project dc512d8e2ab848fda424f9eeb6c816c9. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:27:16.661752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:27:16.664124 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:27:16.715983 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-33091d51-f3a6-42d6-8836-26aa34cb307c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007998 Aug 01 15:27:16.716539 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 199/411] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:27:16.733575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c65d5c67-6a54-4b7a-b05d-a62f08814904 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:16.734382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c65d5c67-6a54-4b7a-b05d-a62f08814904 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:16.823497 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c65d5c67-6a54-4b7a-b05d-a62f08814904 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:16.833827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c65d5c67-6a54-4b7a-b05d-a62f08814904 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1219 microversion: 2.1 time: 0.106087 Aug 01 15:27:16.847921 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 213/412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:16 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:17.544393 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:17.545100 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:17.560774 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:17.561468 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:17.562626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:17.563350 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:17.745403 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:17.762800 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:17.764443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:17.765932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-460da5e4-843d-4c49-bada-f0a0976bd4e0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.226425 Aug 01 15:27:17.766854 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 200/413] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:17 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:17.854149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:17.855439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:17.863862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:17.864558 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:17.865487 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:17.866143 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:17.946460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:17.955548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-427862f5-bc67-4d44-8375-e7a68cf8c519 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1271 microversion: 2.1 time: 0.105183 Aug 01 15:27:17.956447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 214/414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:17 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:18.789530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:18.790189 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:18.797247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:18.797688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:18.798532 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:18.798956 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:18.952975 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:18.966083 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:18.967743 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:18.969151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-22121524-40a9-4507-a7ab-fe673eebcb39 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.183565 Aug 01 15:27:18.969947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 201/415] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:18 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:18.977931 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:18.979765 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:18.990132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:18.990621 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:18.991472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:18.991954 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:19.062770 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:19.071134 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4722137d-f25e-45ea-9f27-9e4503a4d19e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1271 microversion: 2.1 time: 0.097074 Aug 01 15:27:19.072581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 215/416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:18 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:19.995102 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:19.995725 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:20.003313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.003767 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.004530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.004960 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.093995 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:20.095134 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:20.102163 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.102627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.103393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.103832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.157518 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:20.166329 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:20.167808 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:20.168950 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0438fa48-fe6f-45cd-b54f-b25749318330 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.178582 Aug 01 15:27:20.169505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 202/417] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:19 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:20.173498 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:20.181369 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9884c0dd-2913-453c-9965-b73deb796365 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1271 microversion: 2.1 time: 0.091290 Aug 01 15:27:20.181971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 216/418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:20 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:21.193362 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:21.193971 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:21.201015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.201500 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.202238 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:21.202742 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.202835 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:21.203142 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.210388 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.210826 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.211581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.212015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.302305 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:21.312619 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c32a67c2-e540-443f-9e72-2290dfde866f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1271 microversion: 2.1 time: 0.114043 Aug 01 15:27:21.318375 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 217/419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:21 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:21.374261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:21.383155 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:21.384715 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:21.385848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10e2cb10-d83b-4c61-9aa0-e20b7c98ccc1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.196487 Aug 01 15:27:21.386719 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 203/420] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:21 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:22.335483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:22.336081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:22.343409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.343889 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.344682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.345083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.417455 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:22.417924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:22.419539 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:22.424817 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.425273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.426079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.426512 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.427786 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10aeaf3d-19da-4e9e-be61-8b7213646d36 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1271 microversion: 2.1 time: 0.096731 Aug 01 15:27:22.428368 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 218/421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:22 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:22.569493 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:22.579100 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:22.580659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:22.582975 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c71e62f0-acb2-45ec-b439-598e989862a9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.168888 Aug 01 15:27:22.583549 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 204/422] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:22 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:23.449726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:23.450348 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:23.457399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.457869 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.458624 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.459047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.523706 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:23.535989 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a1eacaf3-fb02-4daf-9eda-dea5f052c304 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1279 microversion: 2.1 time: 0.090109 Aug 01 15:27:23.536906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 219/423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:23 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:23.608053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:23.608676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:23.615497 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.615943 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.616705 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.617137 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.783835 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:23.793677 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:23.795614 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:23.796784 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f8a8ee8a-b7d5-46e7-bbb1-7c902f929daa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.192930 Aug 01 15:27:23.797354 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 205/424] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:23 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:24.095164 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d85231c-b5c7-4305-ada8-3774f7a0cf96 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d964f65-7ec9-4505-84f4-050d85333a0a"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:24.098199 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d85231c-b5c7-4305-ada8-3774f7a0cf96 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:24.100096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:24.105666 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d85231c-b5c7-4305-ada8-3774f7a0cf96 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.106140 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d85231c-b5c7-4305-ada8-3774f7a0cf96 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.106910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d85231c-b5c7-4305-ada8-3774f7a0cf96 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.107344 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d85231c-b5c7-4305-ada8-3774f7a0cf96 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.564442 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:24.565136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:24.575459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.576233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.578480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.578480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.690250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d85231c-b5c7-4305-ada8-3774f7a0cf96 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599050 Aug 01 15:27:24.691051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 220/425] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:27:24 2022] POST /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:24.698715 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:24.710843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-93ea0865-16f7-49db-a840-649b782a9f25 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1289 microversion: 2.1 time: 0.150840 Aug 01 15:27:24.710843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 206/426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:24 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:24.821676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:24.822398 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:24.828798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.829237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.830038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.830474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.835079 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:25.045201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:25.053987 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:25.055474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:25.056629 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-496cd638-fc2f-47c9-98d7-94648bb3fcaa tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.240112 Aug 01 15:27:25.057159 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 221/427] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:24 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:25.731805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:25.732457 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:25.740172 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:25.740618 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:25.741380 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:25.741832 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:25.952953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:25.961925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c9218ba0-7aab-48a9-a22f-3802a26c911c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.234330 Aug 01 15:27:25.962503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 207/428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:25 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:25.970967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-7408bd38-c6cc-42e2-8eb7-0e546eb220c7 req-8e066f95-9a64-4645-8b5f-350b75de0186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893c51ab-136f-410d-96f7-0cc474c99a36", "tag": "acd9b96a-3959-4d8c-8e08-37e0a86df34c"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:25.984532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-7408bd38-c6cc-42e2-8eb7-0e546eb220c7 req-8e066f95-9a64-4645-8b5f-350b75de0186 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:25.985160 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-7408bd38-c6cc-42e2-8eb7-0e546eb220c7 req-8e066f95-9a64-4645-8b5f-350b75de0186 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:26.001288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-7408bd38-c6cc-42e2-8eb7-0e546eb220c7 req-8e066f95-9a64-4645-8b5f-350b75de0186 service nova] Creating event network-changed:acd9b96a-3959-4d8c-8e08-37e0a86df34c for instance 893c51ab-136f-410d-96f7-0cc474c99a36 on hv-cinder-84713 Aug 01 15:27:26.006613 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-7408bd38-c6cc-42e2-8eb7-0e546eb220c7 req-8e066f95-9a64-4645-8b5f-350b75de0186 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Aug 01 15:27:26.007253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 222/429] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:26.080941 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:26.081657 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:26.088637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:26.089090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:26.089861 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:26.090302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:26.302109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:26.311169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:26.312659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:26.313820 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45096ed6-5654-4123-8a95-d7e6e63cf4b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.237056 Aug 01 15:27:26.314419 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 208/430] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:26 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:26.982222 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:26.986430 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:26.987267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:26.994824 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:26.995528 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:26.996820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:26.997313 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.139348 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:27.147281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d95998c-b287-4295-8f3c-c2401dcacbfd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.166473 Aug 01 15:27:27.148041 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 223/431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:26 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:27.338328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:27.338915 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:27.340759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:27.341400 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:27.348185 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.348627 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.349370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.349875 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.489701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:27.498800 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:27.500326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:27.501510 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e1fa64b-8613-4572-b25e-7904860eff9f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.168104 Aug 01 15:27:27.502100 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 209/432] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:27 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:28.172205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:28.172819 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:28.181126 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.181575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.182374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.182812 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.317475 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:28.325237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-65c0eef0-f95e-4d6c-b604-617f41578446 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.159276 Aug 01 15:27:28.326050 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 224/433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:28 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:28.525693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:28.526294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:28.533091 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.534025 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.534521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.535068 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.697437 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-01c0d88e-5cfc-467b-9b69-b8100f6ac10c req-73945bfd-3c31-487a-a51e-60cabf96d0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b57efc3-5810-4f01-9863-c16ab9dba00f", "name": "network-vif-plugged", "status": "completed", "tag": "1fafaa48-a913-4b85-9a2b-22a5748ea906"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:28.708758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-01c0d88e-5cfc-467b-9b69-b8100f6ac10c req-73945bfd-3c31-487a-a51e-60cabf96d0ac service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.709125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-01c0d88e-5cfc-467b-9b69-b8100f6ac10c req-73945bfd-3c31-487a-a51e-60cabf96d0ac service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.722961 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-01c0d88e-5cfc-467b-9b69-b8100f6ac10c req-73945bfd-3c31-487a-a51e-60cabf96d0ac service nova] Creating event network-vif-plugged:1fafaa48-a913-4b85-9a2b-22a5748ea906 for instance 7b57efc3-5810-4f01-9863-c16ab9dba00f on hv-cinder-84713 Aug 01 15:27:28.728370 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-01c0d88e-5cfc-467b-9b69-b8100f6ac10c req-73945bfd-3c31-487a-a51e-60cabf96d0ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034980 Aug 01 15:27:28.729392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 225/434] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:28.788754 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:28.797978 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:28.799599 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:28.800790 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a675d4a0-397a-4ee3-a31d-33b20de6fa87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.279022 Aug 01 15:27:28.801833 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 210/435] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:28 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:29.348159 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:29.348924 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:29.355216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.355927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.356929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.357378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.568424 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:29.575792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-47fb901f-bdc6-46fe-979b-089c52654b42 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.232548 Aug 01 15:27:29.576839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 226/436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:29 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:29.829889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:29.830753 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:29.842337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.842933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.844150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.844881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.989007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:29.997820 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:29.999308 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:30.000507 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3b90ac2d-ab5d-4807-bf41-a44a53157766 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.177238 Aug 01 15:27:30.001041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 211/437] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:29 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:30.596587 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:30.597151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:30.604083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:30.604958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:30.605946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:30.606409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:30.737610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:30.752925 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d194512-8440-425f-b4e5-1ef9e379ede3 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.160054 Aug 01 15:27:30.753677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 227/438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:30 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:31.024326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:31.024939 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:31.027460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:31.033859 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.034333 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.035115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.035545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.196726 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:31.210687 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:31.213140 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:31.214954 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d930545c-2b22-4713-abe2-df370fe8850f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.194487 Aug 01 15:27:31.215525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 212/439] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:31 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:31.779205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:31.779927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:31.788998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.789599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.790743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:31.791358 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.946023 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:31.954268 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c4099eb9-87ac-4646-a4e2-6fe4aa8a58cc tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.180829 Aug 01 15:27:31.955148 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 228/440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:31 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:32.241209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:32.241877 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:32.249181 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.249634 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:32.250491 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.250888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:32.267452 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:32.402068 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:32.414209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:32.415968 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:32.417169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-00652c72-703e-4070-b1d4-90aed4b42074 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1809 microversion: 2.20 time: 0.179980 Aug 01 15:27:32.417953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 213/441] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:32 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:32.976951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:32.977610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:32.984577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.985007 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:32.985771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.986219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:33.139625 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:33.148526 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3bfb244-1d40-436c-ab82-e23681c9f022 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.175581 Aug 01 15:27:33.149210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 229/442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:32 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:33.282039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-1d73fd64-f5f8-4151-bded-f667bec8111a req-b299e689-9953-4bf2-8211-49c369a7b21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893c51ab-136f-410d-96f7-0cc474c99a36", "name": "network-vif-plugged", "status": "completed", "tag": "acd9b96a-3959-4d8c-8e08-37e0a86df34c"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:33.299160 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1d73fd64-f5f8-4151-bded-f667bec8111a req-b299e689-9953-4bf2-8211-49c369a7b21a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:33.300055 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1d73fd64-f5f8-4151-bded-f667bec8111a req-b299e689-9953-4bf2-8211-49c369a7b21a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:33.312585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-1d73fd64-f5f8-4151-bded-f667bec8111a req-b299e689-9953-4bf2-8211-49c369a7b21a service nova] Creating event network-vif-plugged:acd9b96a-3959-4d8c-8e08-37e0a86df34c for instance 893c51ab-136f-410d-96f7-0cc474c99a36 on hv-cinder-84713 Aug 01 15:27:33.318177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-1d73fd64-f5f8-4151-bded-f667bec8111a req-b299e689-9953-4bf2-8211-49c369a7b21a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044940 Aug 01 15:27:33.319355 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 214/443] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:33.444727 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:33.445333 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:33.451834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:33.452352 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:33.453126 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:33.453558 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:33.605043 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:33.614644 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:33.616492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:33.617806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-23d78cfe-4e0e-4814-acb9-0e9f955ef3c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1796 microversion: 2.20 time: 0.179703 Aug 01 15:27:33.618589 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 230/444] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:27:33 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1796 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:27:34.172449 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:34.173306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:34.181504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:34.182114 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:34.183073 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:34.183621 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:34.331603 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:34.339958 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-09ab5eec-5567-475a-905c-a0956f9b072b tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.172985 Aug 01 15:27:34.340504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 215/445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:34 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:34.415025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:34.417249 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:34.424004 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:34.424394 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:34.425148 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:34.425585 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:34.448674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lazy-loading 'flavor' on Instance uuid 07157dfb-c02b-4928-9053-f93eed2ef8ef {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:27:34.586699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-995394fc-837c-4c29-b403-d639d23ff327 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/action" status: 200 len: 32 microversion: 2.1 time: 0.178157 Aug 01 15:27:34.587312 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 231/446] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:27:34 2022] POST /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:27:34.596864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:34.597470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:34.603999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:34.604451 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:34.605219 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:34.605653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:34.744237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:34.757113 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-15159e42-6f48-43b2-a3ea-e69094525932 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.163738 Aug 01 15:27:34.758053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 216/447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:34 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:35.363082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:35.363857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:35.372993 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:35.373635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:35.374449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:35.374885 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:35.583660 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:35.592850 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-01e8443e-f550-4191-ac36-2400936725d0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.234231 Aug 01 15:27:35.593641 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 232/448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:35 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:35.784801 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:35.785420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:35.792194 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:35.792649 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:35.793422 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:35.793900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:35.833253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:35.833744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:35.851078 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:35.851528 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:35.852356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:35.852793 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:35.950185 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:35.958622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2fc5e08f-40b8-4aee-b312-9b667a047e25 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.177816 Aug 01 15:27:35.959197 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 217/449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:35 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:35.987141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lazy-loading 'services' on Instance uuid 762918ff-4812-4e05-be65-d3ab81a9ec32 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:27:36.109239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d04cc83b-9c80-4593-9969-acd9256bdd8a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-volume_attachments/4aa135bc-fe60-4db3-b2d0-b9f84a51f1bd" status: 202 len: 0 microversion: 2.1 time: 0.279979 Aug 01 15:27:36.109864 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 233/450] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:27:35 2022] DELETE /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-volume_attachments/4aa135bc-fe60-4db3-b2d0-b9f84a51f1bd => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:27:36.617694 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:36.618826 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:36.629251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:36.630111 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:36.631398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:36.632153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:36.765950 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:36.773934 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de6cf4b9-c157-474c-bf67-d8b438afba9a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1319 microversion: 2.1 time: 0.162748 Aug 01 15:27:36.774539 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 218/451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:36 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:36.985745 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:36.987038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:36.998943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:36.999393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.000160 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:37.000568 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.143305 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:37.155212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b6689fc7-df97-4cff-b4ff-feb646ec6ef2 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.177028 Aug 01 15:27:37.156096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 234/452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:36 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:37.795174 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:37.795787 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:37.804922 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:37.805374 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.806239 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:37.806676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:37.956076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:37.968324 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2aabf90f-1566-4275-b874-5770b3204bc0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1507 microversion: 2.1 time: 0.176805 Aug 01 15:27:37.969006 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 219/453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:37 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:38.179663 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:38.180278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:38.187178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:38.187627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:38.188395 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:38.188834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:38.360321 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:38.370391 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-362a4ee1-7892-4e2e-a97c-b55764a0326f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.194527 Aug 01 15:27:38.371131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 235/454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:38 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:39.390439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ba3cf1b8-4f60-40ed-9084-196d01c50a8c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:39.396311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:39.397032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:39.399400 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba3cf1b8-4f60-40ed-9084-196d01c50a8c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:39.399839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ba3cf1b8-4f60-40ed-9084-196d01c50a8c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:39.406635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:39.407208 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:39.408072 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:39.408666 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:39.426483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ba3cf1b8-4f60-40ed-9084-196d01c50a8c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Going to try to stop instance {{(pid=117824) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 15:27:39.433501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:39.476028 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ba3cf1b8-4f60-40ed-9084-196d01c50a8c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action" status: 202 len: 0 microversion: 2.1 time: 0.089713 Aug 01 15:27:39.476872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 220/455] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:27:39 2022] POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:27:39.485311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:39.486947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:39.493573 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:39.494313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:39.495242 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:39.495831 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:39.633278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:39.641916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7d4ac1a6-ffe3-4e33-ada7-a0b48658ceba tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.250626 Aug 01 15:27:39.642554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 236/456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:39 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:39.671617 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:39.680262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3d1e5aba-f4cb-4dad-a443-c8e1b2cd6db0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.199067 Aug 01 15:27:39.680932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 221/457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:39 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:40.143485 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-623226036", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1355361713", "security_groups": [{"name": "tempest-secgroup-smoke-1405366450"}], "networks": [{"uuid": "2bda4aa6-8293-4da0-8159-fc0b429b4258"}], "block_device_mapping_v2": [{"uuid": "a510a4de-c908-4eb2-aef1-01254a30f58e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:40.258956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] validate_networks() for [('2bda4aa6-8293-4da0-8159-fc0b429b4258', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:27:40.662566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:40.663134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:40.669936 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:40.670384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:40.671279 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:40.671675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:40.873110 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:40.882150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f922ff13-6cb3-40d4-8074-866cef06bca0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.223360 Aug 01 15:27:40.896001 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 222/458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:40 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:40.896001 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:40.896001 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:40.896001 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:40.896474 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:40.896474 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:40.896474 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:41.006371 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:27:41.006866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:27:41.007251 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:27:41.007639 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:27:41.008079 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:27:41.017759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:41.018248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:41.019038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:41.019474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:41.037718 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Getting quotas for project 4ad998384c894fe9aed6d57f7aa1110b. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:27:41.042420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Getting quotas for user 30b9685e174a4523a6c36d4d0bebd5fc and project 4ad998384c894fe9aed6d57f7aa1110b. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:27:41.055809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:41.063899 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-77d34f52-2ef5-48d5-8e6a-88312dab29e9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.180058 Aug 01 15:27:41.064476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 223/459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:40 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:41.102109 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:27:41.104242 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a510a4de-c908-4eb2-aef1-01254a30f58e',volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:27:41.242071 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0f440b57-b488-435a-9a86-4259f784ee4d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.102364 Aug 01 15:27:41.242730 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 237/460] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:27:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:27:41.253817 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-77425f8a-cdcc-4060-bf6e-a3c0172bfc2c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:41.254588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-77425f8a-cdcc-4060-bf6e-a3c0172bfc2c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:41.312150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-77425f8a-cdcc-4060-bf6e-a3c0172bfc2c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:41.320382 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-77425f8a-cdcc-4060-bf6e-a3c0172bfc2c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1088 microversion: 2.1 time: 0.070277 Aug 01 15:27:41.320756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 224/461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:41 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:41.903794 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:41.904554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:41.911231 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:41.911766 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:41.912659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:41.913064 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:42.052501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:42.060761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e2189b5-7148-441e-8214-d18c400a9ab5 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.161533 Aug 01 15:27:42.061329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 238/462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:41 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:42.084778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:42.085379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:42.093147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:42.093770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:42.094695 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:42.095234 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:42.241377 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:42.249693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6934a975-d198-40c3-a54f-e6836989654f tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.169103 Aug 01 15:27:42.250316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 225/463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:42 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:42.348020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:42.348914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:42.357649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:42.358170 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:42.358934 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:42.359403 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:42.424483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:42.433632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4e5a0520-dc20-42b9-9ce4-520d94664ef4 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1186 microversion: 2.1 time: 0.093281 Aug 01 15:27:42.434248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 239/464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:42 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:43.082884 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:43.083540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:43.092126 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.092840 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.093971 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.093971 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.270855 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:43.272509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:43.283293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.283945 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.284916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.286485 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.325241 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:43.340586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-66897b6c-a111-4724-ba04-7db3e5da37ed tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.262456 Aug 01 15:27:43.345820 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 226/465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:43 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:43.455953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:43.456765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:43.464791 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.465250 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.466101 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:43.466590 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:43.585385 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:43.597355 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a1df9dbf-2b9c-4d7f-a75e-0cd6ba91b932 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.330834 Aug 01 15:27:43.598318 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 240/466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:43 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:43.759193 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:43.767676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-657f9c0d-dc30-425b-9012-59782d40067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1272 microversion: 2.1 time: 0.316073 Aug 01 15:27:43.768256 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 227/467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:43 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:44.222016 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-4f3d04c8-e6cc-41bd-b357-50d8f940c053 req-3cf29cb7-7d90-42cf-bcd0-14ac0ec5597d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ec3f25-9dbe-422a-ae74-6376025a9922", "tag": "5b272150-0452-4c62-823d-5973ee6a68f8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:44.234222 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4f3d04c8-e6cc-41bd-b357-50d8f940c053 req-3cf29cb7-7d90-42cf-bcd0-14ac0ec5597d service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:44.235452 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4f3d04c8-e6cc-41bd-b357-50d8f940c053 req-3cf29cb7-7d90-42cf-bcd0-14ac0ec5597d service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:44.253295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-4f3d04c8-e6cc-41bd-b357-50d8f940c053 req-3cf29cb7-7d90-42cf-bcd0-14ac0ec5597d service nova] Creating event network-changed:5b272150-0452-4c62-823d-5973ee6a68f8 for instance 14ec3f25-9dbe-422a-ae74-6376025a9922 on hv-cinder-84713 Aug 01 15:27:44.260921 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-4f3d04c8-e6cc-41bd-b357-50d8f940c053 req-3cf29cb7-7d90-42cf-bcd0-14ac0ec5597d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042875 Aug 01 15:27:44.261531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 241/468] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:27:44.368229 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:44.368851 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:44.375768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:44.376207 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:44.377004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:44.377426 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:44.603942 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:44.612269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e6730b23-1b0a-4f4f-a591-18cf2edea0c0 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.247976 Aug 01 15:27:44.613031 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 228/469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:44 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:44.630383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:44.631082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:44.638583 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:44.639015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:44.639833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:44.640232 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:44.791250 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:44.792775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:44.801045 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:44.801497 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:44.802312 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:44.802741 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:44.908272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:44.917316 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19ac543f-1d9d-4c55-8733-3a6b666177fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.301239 Aug 01 15:27:44.917971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 242/470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:44 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:44.977585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:44.985988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2b55029a-afa0-4dad-8b29-82c25f9ec4d7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.199048 Aug 01 15:27:44.986597 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 229/471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:44 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:45.098380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-80492775-8fde-47f9-a715-dc09d6bfffa7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:45.098991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-80492775-8fde-47f9-a715-dc09d6bfffa7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.109237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80492775-8fde-47f9-a715-dc09d6bfffa7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.109955 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80492775-8fde-47f9-a715-dc09d6bfffa7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.111108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80492775-8fde-47f9-a715-dc09d6bfffa7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.111756 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80492775-8fde-47f9-a715-dc09d6bfffa7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.138530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-80492775-8fde-47f9-a715-dc09d6bfffa7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f/ips" status: 200 len: 149 microversion: 2.1 time: 0.047012 Aug 01 15:27:45.139068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 243/472] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:27:45 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:45.151759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9057c6ee-136b-4447-9eb4-f4d5863bbe97"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:45.154237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.160859 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.161296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.162092 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.162647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.241469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:45.247594 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Invalid volume: volume 9057c6ee-136b-4447-9eb4-f4d5863bbe97 is already attached to instances: 061e74c4-3c31-46e4-af02-799b6e731274 Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f/os-volume_attachments HTTP/1.1 Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 74 Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:27:45.249271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {"volumeAttachment": {"volumeId": "9057c6ee-136b-4447-9eb4-f4d5863bbe97"}} Aug 01 15:27:45.250933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: volume 9057c6ee-136b-4447-9eb4-f4d5863bbe97 is already attached to instances: 061e74c4-3c31-46e4-af02-799b6e731274 Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': '721bdce3-df3b-4543-8e84-eb63f3da2b7f', 'body': {'volumeAttachment': {'volumeId': '9057c6ee-136b-4447-9eb4-f4d5863bbe97'}}} Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9057c6ee-136b-4447-9eb4-f4d5863bbe97 is already attached to instances: 061e74c4-3c31-46e4-af02-799b6e731274 Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.251888 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9057c6ee-136b-4447-9eb4-f4d5863bbe97 is already attached to instances: 061e74c4-3c31-46e4-af02-799b6e731274 Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:45.253316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9057c6ee-136b-4447-9eb4-f4d5863bbe97 is already attached to instances: 061e74c4-3c31-46e4-af02-799b6e731274 Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 400 to user: Invalid volume: volume 9057c6ee-136b-4447-9eb4-f4d5863bbe97 is already attached to instances: 061e74c4-3c31-46e4-af02-799b6e731274 {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0089426b-9c61-4179-b7ee-aa8f77d5b367 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103601 Aug 01 15:27:45.254756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 230/473] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:27:45 2022] POST /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:27:45.262897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:45.263193 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.273164 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.273998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.274760 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.275410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.301517 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:27:45.391853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac86d6fe-7ecf-4543-9248-be83a7bd7cbe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 204 len: 0 microversion: 2.1 time: 0.134712 Aug 01 15:27:45.392414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 244/474] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:27:45 2022] DELETE /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:27:45.402522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:45.404124 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.413585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.414187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.414958 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.415391 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.589755 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:45.597995 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b876c4f2-0f1d-463b-a49e-1531580c5c58 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1682 microversion: 2.1 time: 0.199891 Aug 01 15:27:45.598681 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 231/475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:45 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:45.634136 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:45.634834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.643157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.643515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.644299 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.644732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.783913 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:45.798706 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1231a2b1-ce30-4dec-8326-e208e53ee98a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.168918 Aug 01 15:27:45.799284 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 245/476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:45 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:45.940646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:45.941346 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:45.947876 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.948337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:45.949096 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:45.949505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:46.007592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:46.008256 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:46.014766 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:46.015319 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:46.016175 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:46.016744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:46.130075 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:46.138216 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ebb07871-619f-4bc2-9996-7443cac90099 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.201416 Aug 01 15:27:46.138780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 232/477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:45 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:46.180479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:46.188138 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-460626b4-4422-4122-a24d-a37d187c83cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.185589 Aug 01 15:27:46.188703 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 246/478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:46 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:46.626747 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:46.627965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:46.638469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:46.639182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:46.640446 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:46.641190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:46.789870 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:46.798077 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98450fb3-e5ac-4c56-9b2f-79b4626929e8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1682 microversion: 2.1 time: 0.180509 Aug 01 15:27:46.798811 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 233/479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:46 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:46.824103 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:46.825804 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:46.833910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:46.834886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:46.835997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:46.836432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:46.975776 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:46.984601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b524d197-b729-4085-ac1e-38bf50a3856c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.165993 Aug 01 15:27:46.985187 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 247/480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:46 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:47.161526 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:47.162165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:47.169182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:47.169631 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:47.170707 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:47.171178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:47.209600 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:47.210229 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:47.216948 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:47.217505 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:47.218372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:47.218805 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:47.366843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:47.375168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-558c8fa0-3fca-4324-b023-fafda82c4f47 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.218446 Aug 01 15:27:47.375750 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 234/481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:47 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:47.406285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:47.415824 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c2b00ca7-ba1a-4905-94c9-d1495ba3bb15 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.210266 Aug 01 15:27:47.416312 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 248/482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:47 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:47.820606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:47.821221 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:47.828473 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:47.828923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:47.829696 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:47.830178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:47.971868 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:47.979914 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dc265353-b1ae-465b-8e0a-9124643f7f32 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1682 microversion: 2.1 time: 0.164019 Aug 01 15:27:47.980755 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 235/483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:47 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:48.006314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:48.007131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:48.014537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:48.015018 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:48.015839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:48.016511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:48.201429 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:48.212117 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3ed9871d-bf98-4f6f-9bd7-f020c2b2eb01 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.210288 Aug 01 15:27:48.212721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 249/484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:48 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:48.396979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:48.397484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:48.404805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:48.405617 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:48.406763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:48.407270 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:48.437381 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:48.438476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:48.445262 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:48.445711 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:48.446511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:48.446940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:48.594236 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:48.602498 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f4474fbd-5d7e-4909-b49e-6cf631bbf61d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.209696 Aug 01 15:27:48.603200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 236/485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:48 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:48.622579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:48.630725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0cbaa922-6ef0-4e41-847d-2623c14adf05 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.197873 Aug 01 15:27:48.631308 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 250/486] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:48 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:49.003342 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:49.003921 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:49.012514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.012960 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.013739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.014346 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.232851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:49.233503 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:49.240544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.241075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.241968 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.242477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.583056 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:49.592066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a3869852-a2fe-4360-bf58-65b57bfe2c1e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1682 microversion: 2.1 time: 0.593292 Aug 01 15:27:49.592754 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 237/487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:48 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1682 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:49.624198 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:49.624961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:49.637640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.638218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.639004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.639436 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.702698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:49.711676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eeea999a-5984-4738-aae4-5b6f4800aee4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.482808 Aug 01 15:27:49.712325 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 251/488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:49 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:49.728590 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:49.729200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:49.735513 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.736012 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.736789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:49.737227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:49.963061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:49.970785 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-db472d5e-dd67-4b4f-8328-ff8ee504a9ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.350394 Aug 01 15:27:49.971318 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 238/489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:49 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:50.005146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:50.014638 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96e637e1-fc9d-4413-8e8f-b9c603dabb02 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.289900 Aug 01 15:27:50.015248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 252/490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:49 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:50.473050 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-129896e2-06e9-433f-b490-ed18fd34e1bd req-dba7e251-e6f9-4ccb-8a8c-a2cad9f32e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721bdce3-df3b-4543-8e84-eb63f3da2b7f", "name": "network-vif-deleted", "tag": "aeb89320-34be-4079-be8e-e76a7a04bdc2"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:50.501693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-129896e2-06e9-433f-b490-ed18fd34e1bd req-dba7e251-e6f9-4ccb-8a8c-a2cad9f32e6b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:50.504434 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-129896e2-06e9-433f-b490-ed18fd34e1bd req-dba7e251-e6f9-4ccb-8a8c-a2cad9f32e6b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:50.520689 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-129896e2-06e9-433f-b490-ed18fd34e1bd req-dba7e251-e6f9-4ccb-8a8c-a2cad9f32e6b service nova] Creating event network-vif-deleted:aeb89320-34be-4079-be8e-e76a7a04bdc2 for instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f on hv-cinder-84713 Aug 01 15:27:50.531115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-129896e2-06e9-433f-b490-ed18fd34e1bd req-dba7e251-e6f9-4ccb-8a8c-a2cad9f32e6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066494 Aug 01 15:27:50.532053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 239/491] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:50.616944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:50.618407 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:50.647481 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:50.647862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:50.648658 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:50.649216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:50.671911 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:50.689758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:50.690470 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:50.690919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lazy-loading 'fault' on Instance uuid 721bdce3-df3b-4543-8e84-eb63f3da2b7f {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:27:50.733520 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:50.734416 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:50.734659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:50.741604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:50.742559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:50.743535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:50.744149 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:50.745571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-366e1f42-13cd-4556-acf9-4ed82b4f254b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 200 len: 1332 microversion: 2.1 time: 0.134210 Aug 01 15:27:50.747010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 253/492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:50 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 1332 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:50.895954 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:50.905010 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6312623-73cc-4645-b744-3a38fdd460a6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.175883 Aug 01 15:27:50.906236 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 240/493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:50 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:51.000930 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:51.001807 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:51.008674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.009127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:51.009955 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.010486 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:51.029021 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:51.038185 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:51.039198 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:51.049039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.049874 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:51.050884 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.051534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:51.051740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:51.317020 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:51.343604 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:51.355960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bfd60cbf-74bb-4060-a377-aa2c6af23b89 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.356469 Aug 01 15:27:51.367212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 254/494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:50 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:51.386410 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:51.392664 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-772dd9a1-11a8-46a7-9d6b-07c37555718c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.360706 Aug 01 15:27:51.394298 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 241/495] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:51 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:51.771940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:51.773110 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:51.783342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.783721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:51.787106 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.787548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:51.806267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f HTTP/1.1 Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:27:51.807942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:27:51.809393 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '721bdce3-df3b-4543-8e84-eb63f3da2b7f'} Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:51.810280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:27:51.811669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:27:51.813071 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:51.813071 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6d64826e-393f-4399-bc2f-25f0e4a008f0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 404 len: 111 microversion: 2.1 time: 0.041706 Aug 01 15:27:51.813628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 255/496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:51 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:27:51.818593 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2d03e918-4012-4931-9067-990b0feb20ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '.version_select at 0x7f036758a160>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:51.847053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2d03e918-4012-4931-9067-990b0feb20ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527833541" status: 202 len: 0 microversion: 2.1 time: 0.032177 Aug 01 15:27:51.847658 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 242/497] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 15:27:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527833541 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:27:51.926684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:51.927615 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:51.935200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.935648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:51.936432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:51.936864 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.119863 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:52.130871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-04354f0e-bbb4-4129-b1c9-de695a7cf043 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.208055 Aug 01 15:27:52.131446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 256/498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:51 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:52.379871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:52.380472 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:52.388316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.388829 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.389616 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.390254 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.414353 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:52.415001 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:52.430154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.430957 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.443499 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.444114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.606215 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:52.614281 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-334cb230-b7a2-4a9b-9b05-a95b35125cee tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.238233 Aug 01 15:27:52.622194 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 243/499] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:52 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:52.637067 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:52.644869 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-58c698bc-67cd-4233-b537-428e8c723acc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.234350 Aug 01 15:27:52.645538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 257/500] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:52 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:52.678057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:52.678655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:52.685579 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.686057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.686842 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.687271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.818160 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lazy-loading 'services' on Instance uuid 061e74c4-3c31-46e4-af02-799b6e731274 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:27:52.937085 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-855499d1-7475-4c00-a5ee-a403d7fbbdb0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments/9057c6ee-136b-4447-9eb4-f4d5863bbe97" status: 202 len: 0 microversion: 2.1 time: 0.262908 Aug 01 15:27:52.937835 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 244/501] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:27:52 2022] DELETE /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments/9057c6ee-136b-4447-9eb4-f4d5863bbe97 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:27:52.946379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7dc12fbc-3d60-4bed-ac82-3cfecedf24f1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:52.948665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7dc12fbc-3d60-4bed-ac82-3cfecedf24f1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:52.951059 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:52.957819 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dc12fbc-3d60-4bed-ac82-3cfecedf24f1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.958281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dc12fbc-3d60-4bed-ac82-3cfecedf24f1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.959396 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dc12fbc-3d60-4bed-ac82-3cfecedf24f1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:52.959829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7dc12fbc-3d60-4bed-ac82-3cfecedf24f1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:52.992524 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7dc12fbc-3d60-4bed-ac82-3cfecedf24f1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050169 Aug 01 15:27:52.993372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 258/502] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:27:52 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:53.152751 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:53.153515 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:53.160012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:53.160462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:53.161333 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:53.162015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:53.302826 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:53.311828 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fed12090-419a-4776-9b58-a83a232a0828 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.163296 Aug 01 15:27:53.312292 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 245/503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:53 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:53.636447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:53.636789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:53.643240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:53.643699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:53.644468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:53.644895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:53.668069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:53.669228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:53.675823 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:53.676275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:53.677033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:53.677455 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:53.847332 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:53.859873 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-575d189b-57f1-4dfd-b9f0-9c11f443960b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.227644 Aug 01 15:27:53.860458 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 259/504] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:53 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:53.880900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:53.888845 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c01186ef-f032-40a9-ba6f-d7c7f58fd73e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.225104 Aug 01 15:27:53.889346 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 246/505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:53 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:54.007696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00d51125-33fb-4179-aba1-a3fc68a05bd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:54.010816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00d51125-33fb-4179-aba1-a3fc68a05bd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:54.019223 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00d51125-33fb-4179-aba1-a3fc68a05bd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.019673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00d51125-33fb-4179-aba1-a3fc68a05bd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.020425 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00d51125-33fb-4179-aba1-a3fc68a05bd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.020887 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00d51125-33fb-4179-aba1-a3fc68a05bd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.059176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00d51125-33fb-4179-aba1-a3fc68a05bd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057728 Aug 01 15:27:54.059786 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 260/506] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:27:53 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:54.343003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:54.343654 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:54.351287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.351786 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.352693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.353193 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.494305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:54.502631 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4db0e9a1-5934-4e6e-8b5e-e8ba84c3bd02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.164090 Aug 01 15:27:54.503198 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 247/507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:54 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:54.884173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:54.884794 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:54.891519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.891969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.892739 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.893264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.910511 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:54.911285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:54.917512 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.918319 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.919158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:54.919659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:54.935308 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:55.095851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:55.104020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d3639ed-ba28-46fc-9649-2a890cea8737 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.225290 Aug 01 15:27:55.104577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 261/508] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:54 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:55.109631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f91b372e-0ae6-485a-b650-efc3523479bf tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:55.111778 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f91b372e-0ae6-485a-b650-efc3523479bf tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:55.116496 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:55.117890 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91b372e-0ae6-485a-b650-efc3523479bf tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:55.118341 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91b372e-0ae6-485a-b650-efc3523479bf tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:55.119119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91b372e-0ae6-485a-b650-efc3523479bf tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:55.119556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f91b372e-0ae6-485a-b650-efc3523479bf tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:55.124632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5bece53b-527e-4fc9-9e77-0bc357af507c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.218426 Aug 01 15:27:55.125194 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 248/509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:54 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:55.149198 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f91b372e-0ae6-485a-b650-efc3523479bf tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Aug 01 15:27:55.149763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 262/510] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:27:55 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:55.527925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:55.528911 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:55.540101 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:55.540670 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:55.541465 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:55.542213 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:55.696855 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:55.705284 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17aa96ff-e6a2-4493-aba1-b0b8458cd84d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.184563 Aug 01 15:27:55.705884 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 249/511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:55 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:56.128138 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:56.128897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:56.137563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.138014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.138800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.139227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.145058 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:56.145688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:56.152870 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.153305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.154137 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.154575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.345039 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:56.348951 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:56.352967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0ce8d4fe-9007-4f15-bf66-22251a0fc5e7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.231239 Aug 01 15:27:56.353813 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 263/512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:56 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:56.356850 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-13aaba8a-becd-411a-90ec-3bca4ee7b1bf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.215665 Aug 01 15:27:56.357547 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 250/513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:56 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:56.358608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc8b6571-edd9-46c5-90f6-e02a07a1a9c0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:56.360783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc8b6571-edd9-46c5-90f6-e02a07a1a9c0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:56.366866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc8b6571-edd9-46c5-90f6-e02a07a1a9c0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.367318 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc8b6571-edd9-46c5-90f6-e02a07a1a9c0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.368173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc8b6571-edd9-46c5-90f6-e02a07a1a9c0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.368613 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc8b6571-edd9-46c5-90f6-e02a07a1a9c0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.398284 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc8b6571-edd9-46c5-90f6-e02a07a1a9c0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043344 Aug 01 15:27:56.398763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 264/514] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:27:56 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:27:56.463988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:56.464484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:56.472677 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.473233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.474961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.475645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.508124 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:27:56.594080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dbab8c68-5f4e-4c67-9e3a-7322e8cfc4c6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 204 len: 0 microversion: 2.1 time: 0.135159 Aug 01 15:27:56.594775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 251/515] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:27:56 2022] DELETE /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:27:56.603663 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:56.604279 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:56.610462 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.610939 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.611767 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.612200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.734758 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:56.735488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:56.741889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.742335 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.743147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:56.743574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:56.750647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:56.758361 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f4f06af5-d262-426d-9265-0fdc07e4646e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1679 microversion: 2.1 time: 0.159035 Aug 01 15:27:56.759069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 265/516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:56 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:56.875913 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:56.885269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0123c876-2f2e-4342-b7f3-fd472d6edb94 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.154739 Aug 01 15:27:56.885865 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 252/517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:56 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:57.374629 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.375231 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:57.378122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.379056 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:57.383764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.384364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.385902 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.386432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.387196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.387618 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.388695 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.389240 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.598953 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:57.602073 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:57.609387 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5321069-da7f-49e2-bf51-8515e5998a3b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.238663 Aug 01 15:27:57.610188 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 266/518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:57.611300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7beeffc9-d978-48ee-8b1e-4147c81843eb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.237255 Aug 01 15:27:57.620614 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 253/519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:57.782648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.783472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:57.792154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.792680 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.793726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.794401 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.909890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:57.910608 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:57.917605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.918433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.919009 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:57.919514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:57.937633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:57.945330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f4059156-3a93-47ac-9d57-2cc04f72b9f3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1679 microversion: 2.1 time: 0.168235 Aug 01 15:27:57.946203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 267/520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:58.073352 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:58.081904 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-65c2d3c8-9c2e-4085-9eec-8730cceb221a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.175864 Aug 01 15:27:58.082526 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 254/521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:57 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:58.633399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:58.634287 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:58.634768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:58.635597 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:58.644406 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.644933 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.646059 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.646672 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.647514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.648175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.649361 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.649822 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.853545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:58.856299 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:58.861747 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45fe4bbd-68d7-4d12-a1be-df7420894199 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.232764 Aug 01 15:27:58.862465 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 255/522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:58 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:58.864522 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95a18f7d-b05b-425d-a0ad-66cd8c55821c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.236975 Aug 01 15:27:58.865252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 268/523] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:58 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:58.967784 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:58.968324 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:58.975054 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.975495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:58.976245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:58.976676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.103940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:59.105061 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:59.111990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.112429 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.113247 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.113649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.153361 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:59.161088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d726a3db-df42-4d70-8fe3-f54643eb5b7d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1679 microversion: 2.1 time: 0.197470 Aug 01 15:27:59.161675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 256/524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:58 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:59.263456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:59.274978 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ee6c752e-72c8-491c-995c-dde9e5a45250 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.175147 Aug 01 15:27:59.275574 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 269/525] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:59 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:59.487469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-645e3d40-4aa5-4679-9780-06dde6c6e831 req-640da95a-8c57-45fd-a5fc-74bee3fd25ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ec3f25-9dbe-422a-ae74-6376025a9922", "name": "network-vif-plugged", "status": "completed", "tag": "5b272150-0452-4c62-823d-5973ee6a68f8"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:59.493376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:59.499850 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-645e3d40-4aa5-4679-9780-06dde6c6e831 req-640da95a-8c57-45fd-a5fc-74bee3fd25ca service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.500248 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-645e3d40-4aa5-4679-9780-06dde6c6e831 req-640da95a-8c57-45fd-a5fc-74bee3fd25ca service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.515953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-645e3d40-4aa5-4679-9780-06dde6c6e831 req-640da95a-8c57-45fd-a5fc-74bee3fd25ca service nova] Creating event network-vif-plugged:5b272150-0452-4c62-823d-5973ee6a68f8 for instance 14ec3f25-9dbe-422a-ae74-6376025a9922 on hv-cinder-84713 Aug 01 15:27:59.521530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-645e3d40-4aa5-4679-9780-06dde6c6e831 req-640da95a-8c57-45fd-a5fc-74bee3fd25ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037961 Aug 01 15:27:59.522174 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 257/526] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:59.769431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4c80fec0-f886-4a0a-b87b-15061d088a16 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05d7ba49-4e99-443a-98a7-69d2c5fc9efc", "device": "/dev/sdb"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:59.772378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4c80fec0-f886-4a0a-b87b-15061d088a16 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:59.779695 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c80fec0-f886-4a0a-b87b-15061d088a16 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.780138 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c80fec0-f886-4a0a-b87b-15061d088a16 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.780915 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c80fec0-f886-4a0a-b87b-15061d088a16 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.781347 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4c80fec0-f886-4a0a-b87b-15061d088a16 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.785384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:59.884433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:59.885127 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:59.894836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.895305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:59.896117 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:59.896535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.050586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:00.058532 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-73c88a97-4e25-42ac-a7e2-31ece027e848 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.179843 Aug 01 15:28:00.059174 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 258/527] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:59 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:00.064128 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:00.064826 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:00.071494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:00.072013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.072778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:00.073208 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.226580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:00.234991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a40659b-0772-44cd-b389-6a8ce334b132 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1680 microversion: 2.1 time: 0.174779 Aug 01 15:28:00.235562 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 259/528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:00 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:00.240038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:00.240646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:00.247841 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:00.248289 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.249070 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:00.249501 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.394841 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:00.403028 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8e8e25db-d442-43ad-9896-af4d274935f7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1679 microversion: 2.1 time: 0.166405 Aug 01 15:28:00.403582 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 260/529] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:00 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:00.408566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:00.409146 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:00.417816 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:00.418271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.419036 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:00.419459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:00.883337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:00.895484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0dd93719-e1f8-4e3b-94ac-69640228f86a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.490765 Aug 01 15:28:00.896826 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 261/530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:00 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:01.066990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4c80fec0-f886-4a0a-b87b-15061d088a16 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "POST /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.301596 Aug 01 15:28:01.068912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 270/531] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:27:59 2022] POST /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36/os-volume_attachments => generated 194 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:01.083158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:01.084130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:01.098866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.100222 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.101364 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.104573 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.267866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:01.269405 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:01.284115 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.284845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.286200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.287011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.591186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:01.596121 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:01.599513 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a3c2ed9-fbe8-43ee-b3da-27059c73e681 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.520376 Aug 01 15:28:01.600355 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 262/532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:01 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:01.605059 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:01.605932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:01.607163 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a828a960-d810-461a-84f0-e0fec8431e5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1657 microversion: 2.1 time: 0.349204 Aug 01 15:28:01.608238 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 271/533] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:01 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1657 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:01.617316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.618032 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.618864 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.619280 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.632537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-56dc8917-4a1f-481d-8141-5e02877944d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:01.639657 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56dc8917-4a1f-481d-8141-5e02877944d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.640409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56dc8917-4a1f-481d-8141-5e02877944d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.663300 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-56dc8917-4a1f-481d-8141-5e02877944d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Going to try to start instance {{(pid=117825) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 15:28:01.710093 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-56dc8917-4a1f-481d-8141-5e02877944d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action" status: 202 len: 0 microversion: 2.1 time: 0.081035 Aug 01 15:28:01.711597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 272/534] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:28:01 2022] POST /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:28:01.721477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:01.722963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:01.732277 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.733643 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.734461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.735026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.735789 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:01.746980 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1ef5db1f-d8e3-45ee-9a14-a8378b47b3f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1612 microversion: 2.1 time: 0.145331 Aug 01 15:28:01.748351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 263/535] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:01 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1612 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:01.918399 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:01.919061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:01.926772 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.927203 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.927993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:01.928467 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:01.933830 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:01.969054 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:01.977415 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e203a22-1508-40a8-ba65-43e9db36ffc0 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1666 microversion: 2.1 time: 0.260754 Aug 01 15:28:01.990490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 273/536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:01 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1666 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:02.082549 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-7991b791-4cdd-4ea0-975a-fab7632460b0 req-3e4a4fc7-65a5-47ed-815a-e0c3e4cf52bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061e74c4-3c31-46e4-af02-799b6e731274", "name": "network-vif-deleted", "tag": "09d33995-f714-4442-b466-5fcfa7ebc913"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:02.101002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-7991b791-4cdd-4ea0-975a-fab7632460b0 req-3e4a4fc7-65a5-47ed-815a-e0c3e4cf52bc service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.101737 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-7991b791-4cdd-4ea0-975a-fab7632460b0 req-3e4a4fc7-65a5-47ed-815a-e0c3e4cf52bc service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.113963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-7991b791-4cdd-4ea0-975a-fab7632460b0 req-3e4a4fc7-65a5-47ed-815a-e0c3e4cf52bc service nova] Creating event network-vif-deleted:09d33995-f714-4442-b466-5fcfa7ebc913 for instance 061e74c4-3c31-46e4-af02-799b6e731274 on hv-cinder-84713 Aug 01 15:28:02.118845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-7991b791-4cdd-4ea0-975a-fab7632460b0 req-3e4a4fc7-65a5-47ed-815a-e0c3e4cf52bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041198 Aug 01 15:28:02.119836 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 274/537] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:28:02.125865 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:02.134082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b3ea4d67-9878-447d-ba8b-e1cd4e098b9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.220131 Aug 01 15:28:02.134670 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 264/538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:01 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:02.632356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:02.637178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:02.651288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.651823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.652714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.653206 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.770295 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:02.771182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:02.777445 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.777929 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.778709 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:02.779137 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:02.794723 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:02.804740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a21c8054-3063-44bc-8360-0463323f0f7c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1260 microversion: 2.1 time: 0.185597 Aug 01 15:28:02.805843 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 275/539] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:02 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:02.849907 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:02.857692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e993c555-0f98-4521-80bd-b986dd76a245 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1324 microversion: 2.1 time: 0.091540 Aug 01 15:28:02.858370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 265/540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:02 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1324 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:02.999877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:03.000553 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:03.007275 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.007725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.008497 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.008929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.146270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:03.156567 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-afd3b5db-43d8-47c8-a252-5398cdf11584 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1666 microversion: 2.1 time: 0.160273 Aug 01 15:28:03.157636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 276/541] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:02 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:03.170087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:03.170087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:03.170087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.170087 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.170858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.170858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.366874 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:03.377942 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-25955d4d-644f-4e34-be1d-8b184aebc7c8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1733 microversion: 2.1 time: 0.224381 Aug 01 15:28:03.378405 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 266/542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:03 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:03.827278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:03.827921 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:03.835711 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.836156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.837036 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.837463 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.879562 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:03.880275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:03.887123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.887563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.888332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.888752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.929159 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:03.930359 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:03.931305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lazy-loading 'fault' on Instance uuid 061e74c4-3c31-46e4-af02-799b6e731274 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:03.988206 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:03.997457 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-03faf10e-72ef-4afc-b851-1629f2ff3874 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1329 microversion: 2.1 time: 0.121410 Aug 01 15:28:03.998457 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 267/543] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:03 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1329 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:04.030560 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:04.041338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-71b8213f-9909-4875-b2e2-985bbe95eeac tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1443 microversion: 2.1 time: 0.217901 Aug 01 15:28:04.042161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 277/544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:03 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1443 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:04.062477 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.063222 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.069769 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.070347 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.071199 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.071712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.180280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.181014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.189876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.189876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.190708 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.190708 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.242574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:04.250717 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4f027698-b0dc-458e-91ad-662b0298a4be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1443 microversion: 2.1 time: 0.192280 Aug 01 15:28:04.251606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 268/545] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1443 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:04.348276 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:04.364289 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4120069a-bb64-4126-8510-732c1b9efd1c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1666 microversion: 2.1 time: 0.187981 Aug 01 15:28:04.364965 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 278/546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1666 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:04.399585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.400187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.407989 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.408436 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.409631 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.410158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.555418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:04.564817 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ace72f2c-0b3a-4316-b5d1-4470144fecdd tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1713 microversion: 2.1 time: 0.169169 Aug 01 15:28:04.565393 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 269/547] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1713 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:04.684533 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.685827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.691367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.691813 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.692608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.693040 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.795405 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] HTTP exception thrown: Cannot 'detach_volume' instance 07157dfb-c02b-4928-9053-f93eed2ef8ef while it is in vm_state rescued Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Request method failure captured: Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments/4d964f65-7ec9-4505-84f4-050d85333a0a HTTP/1.1 Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AOu_gdPJh0fnK6IS6_RTfqlgP9yrCVUGQhjW_TZeS1pFWe7vx8I5l9_sgQyQZoDiqSD5GtGFTLQuG5OUSscK7EY_2AKImIIGZJWxUiBnAzw94Vx0O3XIMK_l0OwZ2sdoCKY_nEhejN9WsqralWbhs4hTuS-P0k6e3k4fdszvGJ9K4 Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:28:04.797433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}] Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 6f852249c66a4f8986d7a63a957ec91c Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:28:04.799076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Cannot 'detach_volume' instance 07157dfb-c02b-4928-9053-f93eed2ef8ef while it is in vm_state rescued Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '07157dfb-c02b-4928-9053-f93eed2ef8ef', 'id': '4d964f65-7ec9-4505-84f4-050d85333a0a'} Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07157dfb-c02b-4928-9053-f93eed2ef8ef in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:28:04.799852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 07157dfb-c02b-4928-9053-f93eed2ef8ef while it is in vm_state rescued Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 07157dfb-c02b-4928-9053-f93eed2ef8ef while it is in vm_state rescued Aug 01 15:28:04.801196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:04.802908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Returning 409 to user: Cannot 'detach_volume' instance 07157dfb-c02b-4928-9053-f93eed2ef8ef while it is in vm_state rescued {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:28:04.803836 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57503c13-07e3-4e7e-a8af-2bae8d86c588 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "DELETE /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments/4d964f65-7ec9-4505-84f4-050d85333a0a" status: 409 len: 152 microversion: 2.1 time: 0.123816 Aug 01 15:28:04.804434 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 279/548] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:28:04 2022] DELETE /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments/4d964f65-7ec9-4505-84f4-050d85333a0a => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:28:04.813514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c93edbe2-4d10-4c78-bee2-7f656b73e0f8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:04.814330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c93edbe2-4d10-4c78-bee2-7f656b73e0f8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.823685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c93edbe2-4d10-4c78-bee2-7f656b73e0f8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.825932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c93edbe2-4d10-4c78-bee2-7f656b73e0f8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.825932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c93edbe2-4d10-4c78-bee2-7f656b73e0f8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.825932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c93edbe2-4d10-4c78-bee2-7f656b73e0f8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.915788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c93edbe2-4d10-4c78-bee2-7f656b73e0f8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "POST /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/action" status: 202 len: 0 microversion: 2.1 time: 0.106213 Aug 01 15:28:04.916458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 270/549] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:28:04 2022] POST /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:28:04.925255 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:04.927076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:04.935663 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.936390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:04.937330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:04.938117 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.020786 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:05.021812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:05.039163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.039730 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.040646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.041211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.087635 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.088415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.089129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lazy-loading 'fault' on Instance uuid 061e74c4-3c31-46e4-af02-799b6e731274 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:05.171911 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:05.179720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ef4b2398-47ca-4bc2-9e78-60a24a28ae2b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 200 len: 1329 microversion: 2.1 time: 0.164261 Aug 01 15:28:05.180244 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 271/550] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:05 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 1329 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:05.194184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:05.205894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9e9fa47b-649c-4810-aa30-7260611310d7 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.284925 Aug 01 15:28:05.206671 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 280/551] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:04 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:05.388743 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:05.390030 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:05.397018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.397702 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.398825 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:05.399210 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:05.551553 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:05.565220 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9a0e75a3-541d-495f-8bb5-9d0e581a18a3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1666 microversion: 2.1 time: 0.176541 Aug 01 15:28:05.568273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 272/552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:05 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:06.200920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:06.202833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:06.212430 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.213176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.214448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.215046 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.227623 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:06.228540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:06.235715 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.236442 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.237390 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.238037 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.247212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 HTTP/1.1 Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:28:06.248783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:28:06.250364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '061e74c4-3c31-46e4-af02-799b6e731274'} Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:28:06.251171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:28:06.252496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:28:06.253689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:28:06.253689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca2e28e9-5ea9-4108-b8b9-eead55dad0ca tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 404 len: 111 microversion: 2.1 time: 0.054524 Aug 01 15:28:06.253689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 281/553] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:06 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:28:06.260009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c925b2bc-5822-468e-b0fc-bf01894d808b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '.version_select at 0x7f03673ed1f0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:06.307519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c925b2bc-5822-468e-b0fc-bf01894d808b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118309408" status: 202 len: 0 microversion: 2.1 time: 0.051394 Aug 01 15:28:06.308373 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 282/554] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 15:28:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118309408 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:28:06.502024 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-3c9e62f7-1ca6-459e-8aba-7269bb0dda58 req-1a6aa9e6-1710-4b96-b3e3-01b90fbc673b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ec3f25-9dbe-422a-ae74-6376025a9922", "tag": "5b272150-0452-4c62-823d-5973ee6a68f8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:06.516805 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3c9e62f7-1ca6-459e-8aba-7269bb0dda58 req-1a6aa9e6-1710-4b96-b3e3-01b90fbc673b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.517583 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3c9e62f7-1ca6-459e-8aba-7269bb0dda58 req-1a6aa9e6-1710-4b96-b3e3-01b90fbc673b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.533832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-3c9e62f7-1ca6-459e-8aba-7269bb0dda58 req-1a6aa9e6-1710-4b96-b3e3-01b90fbc673b service nova] Creating event network-changed:5b272150-0452-4c62-823d-5973ee6a68f8 for instance 14ec3f25-9dbe-422a-ae74-6376025a9922 on hv-cinder-84713 Aug 01 15:28:06.540869 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-3c9e62f7-1ca6-459e-8aba-7269bb0dda58 req-1a6aa9e6-1710-4b96-b3e3-01b90fbc673b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042087 Aug 01 15:28:06.542753 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 283/555] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:28:06.593175 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:06.593942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:06.602246 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.603055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.604080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:06.604672 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:06.891676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:06.905607 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c217376-2264-42ae-9ba1-d48bdf4e16d3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.681974 Aug 01 15:28:06.906306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 273/556] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:06 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:07.106125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:07.114943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d6fda2e0-da01-40de-a621-df2e30ed7ccf tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1666 microversion: 2.1 time: 0.529660 Aug 01 15:28:07.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 284/557] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:06 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1666 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:07.534973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2899b8f6-72cb-415f-b7c9-106dbd5f6609 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: .version_select at 0x7f036735ae50>, body: {"keypair": {"name": "tempest-keypair-1192532736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6IOPQ+JC/aQ0GfJ/+1XOSbIxc2DLed6YI4pQDVTJLg+tQUk5h1X5EM6gT2sUkzezCLOmgcNG/MydbCqf3/mUVZob571hSKcUijGwn6ekRE68DjqCWA6iI1DuCXhBHtVw=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:07.550882 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-2899b8f6-72cb-415f-b7c9-106dbd5f6609 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:07.554836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-2899b8f6-72cb-415f-b7c9-106dbd5f6609 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:07.578191 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2899b8f6-72cb-415f-b7c9-106dbd5f6609 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047318 Aug 01 15:28:07.579027 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 274/558] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:28:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:07.927743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:07.928351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:07.936807 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:07.937302 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:07.938142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:07.938575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:08.136931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:08.138297 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:08.144788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:08.145217 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:08.146201 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:08.146624 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:08.151721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:08.159955 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f0bff224-bd84-4d9a-9b53-44ef2d55451b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.236647 Aug 01 15:28:08.160722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 285/559] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:07 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:08.373096 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:08.380930 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-529a6e76-0d06-4448-bb24-176085f09909 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1666 microversion: 2.1 time: 0.248204 Aug 01 15:28:08.381532 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 275/560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:08 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1666 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:08.968868 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-322957929", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7ed53a-69a3-4296-8374-cca80fe55475"}], "security_groups": [{"name": "tempest-securitygroup--729715018"}], "key_name": "tempest-keypair-1192532736", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:09.081587 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] validate_networks() for [('9b7ed53a-69a3-4296-8374-cca80fe55475', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:28:09.183306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:09.183925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:09.191183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.191601 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.192632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.193068 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.405969 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:09.415014 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-628af8a0-896e-4d0f-bdb3-ff0ccabd3ada tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.236402 Aug 01 15:28:09.426008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 276/561] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:09 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:09.426008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:09.426008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:09.429133 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.429133 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.429133 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.429133 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.591842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:28:09.592264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:28:09.592704 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:28:09.593314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:28:09.593912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:28:09.603263 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.603705 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.604472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:09.604937 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:09.614937 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:09.622805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-76f402de-f567-4327-bded-142e747f9198 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1666 microversion: 2.1 time: 0.205578 Aug 01 15:28:09.623394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 277/562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:09 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:09.623946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:09.628142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:09.640420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:28:09.642925 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:28:09.698874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8d7650c-e547-4116-8038-8bdb41e7817d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.734245 Aug 01 15:28:09.699556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 286/563] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:28:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:28:09.712511 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4b1343e3-b6dd-4707-b981-b25486180123 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:09.713107 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4b1343e3-b6dd-4707-b981-b25486180123 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:09.773528 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4b1343e3-b6dd-4707-b981-b25486180123 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:09.781097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4b1343e3-b6dd-4707-b981-b25486180123 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1241 microversion: 2.1 time: 0.072834 Aug 01 15:28:09.781648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 278/564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:09 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:10.438125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:10.438748 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:10.446406 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:10.446878 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:10.447687 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:10.448404 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:10.584881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:10.594977 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3b0442d-1562-4c21-b0cb-9087f42fdee3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.160549 Aug 01 15:28:10.595694 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 287/565] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:10 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:10.643591 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:10.644165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:10.652477 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:10.652903 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:10.654646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:10.654646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:10.799502 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:10.804732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:10.805420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:10.807406 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6519fb3-e529-45a9-b305-9544a134d57a tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1670 microversion: 2.1 time: 0.167808 Aug 01 15:28:10.807960 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 279/566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:10 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:10.811683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:10.812293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:10.813604 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:10.813841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:10.819033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:10.882160 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:10.890082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7d2b4476-ec36-4920-bd56-abe01d6c1e4a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1245 microversion: 2.1 time: 0.091074 Aug 01 15:28:10.890675 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 288/567] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:10 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:11.619870 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:11.620633 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:11.628656 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:11.629110 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:11.629906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:11.630342 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:11.781474 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:11.792179 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3f5dcf37-92ea-45a6-955c-7015751f07a4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.178366 Aug 01 15:28:11.792765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 280/568] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:11 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:11.912035 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:11.912743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:11.920233 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:11.920642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:11.921443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:11.921908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:11.985491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:11.993762 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-da4207a7-e7eb-476a-9a03-40e5d12bb8c2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1245 microversion: 2.1 time: 0.085597 Aug 01 15:28:11.994361 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 289/569] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:11 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:12.820283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:12.820903 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:12.827564 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:12.827994 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:12.828792 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:12.829223 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:12.832069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:12.965489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:12.973937 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e6d8a8c-b91e-4433-bc45-f73b89365698 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.157596 Aug 01 15:28:12.974506 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 281/570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:12 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:13.014865 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:13.015548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:13.022758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:13.023208 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:13.023979 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:13.024435 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:13.092379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:13.100256 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8acfbe09-3ada-41eb-b357-6e814f8d4ac0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1245 microversion: 2.1 time: 0.089293 Aug 01 15:28:13.100832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 290/571] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:13 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:13.999683 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:14.000724 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:14.010974 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:14.011417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:14.012168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:14.012587 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:14.121263 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:14.121910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:14.128962 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:14.129411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:14.130217 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:14.130662 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:14.151463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:14.159599 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e56a348d-c530-419d-9fff-1f0a45f23ea3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.166561 Aug 01 15:28:14.160340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 282/572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:13 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:14.193168 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:14.201346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1f2b478c-9d4d-4208-b50a-2a1cfad4d43d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1245 microversion: 2.1 time: 0.084612 Aug 01 15:28:14.201940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 291/573] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:14 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:15.185967 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:15.186756 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:15.195421 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:15.195991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:15.196933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:15.197470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:15.222852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:15.223435 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:15.230677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:15.231126 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:15.231876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:15.232314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:15.309015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:15.320362 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-da73bff1-5969-4d40-81b9-9a3588bab227 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1245 microversion: 2.1 time: 0.101231 Aug 01 15:28:15.320893 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 292/574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:15 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:15.362217 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:15.370987 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-db263e89-913a-4635-a8a7-0d7b23b96533 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.190087 Aug 01 15:28:15.371557 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 283/575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:15 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:16.342786 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:16.343389 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:16.350306 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:16.350742 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:16.351496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:16.351920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:16.392677 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:16.393293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:16.400289 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:16.400736 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:16.401510 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:16.402075 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:16.414974 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:16.422859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0f92016-f658-4168-938e-ac67533d412f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1237 microversion: 2.1 time: 0.083950 Aug 01 15:28:16.423758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 293/576] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:16 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:16.543507 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:16.555825 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-784184a5-77dd-4ccd-8fc9-a30cb3d3ddce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.166762 Aug 01 15:28:16.556700 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 284/577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:16 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:17.444898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:17.445509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:17.453015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:17.453464 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:17.454262 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:17.454698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:17.516192 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:17.523825 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-52622251-7f70-4bc0-870e-2afe045b998f tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1237 microversion: 2.1 time: 0.082898 Aug 01 15:28:17.524394 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 294/578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:17 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:17.584803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:17.585409 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:17.593207 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:17.593648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:17.594452 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:17.594871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:17.732978 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:17.746007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-491b301f-00b9-416f-9765-5fac267ce009 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.165513 Aug 01 15:28:17.746984 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 285/579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:17 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:18.546631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:18.547348 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:18.556238 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:18.556620 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:18.557388 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:18.557906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:18.625457 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:18.635639 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bb4b66cc-190a-4c68-950c-3d8b957ae8fc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1237 microversion: 2.1 time: 0.093976 Aug 01 15:28:18.636252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 295/580] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:18 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:18.778934 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:18.779606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:18.790046 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:18.790732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:18.791480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:18.791939 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:18.936585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:18.946499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10752783-c6b9-4a02-9a81-33073fa0d51b tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1721 microversion: 2.1 time: 0.173593 Aug 01 15:28:18.947201 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 286/581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:18 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:19.665355 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:19.666063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:19.668551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:19.669248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:19.675422 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:19.675859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:19.676624 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:19.677079 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:19.742891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:19.753139 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5bf80284-6b9d-4849-972a-a99de50112fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1293 microversion: 2.1 time: 0.092266 Aug 01 15:28:19.753723 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 296/582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:19 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:19.968871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:19.969606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:19.971551 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:19.977584 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:19.978099 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:19.978999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:19.979375 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:20.122866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:20.130952 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3805ed6f-c34d-4a7a-9fc2-b6480e028449 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1727 microversion: 2.1 time: 0.166035 Aug 01 15:28:20.131522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 287/583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:19 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:20.153386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a3564c89-a1c3-4fb9-a260-ee68c796bbe1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:20.153908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a3564c89-a1c3-4fb9-a260-ee68c796bbe1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:20.161330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3564c89-a1c3-4fb9-a260-ee68c796bbe1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:20.161796 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3564c89-a1c3-4fb9-a260-ee68c796bbe1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:20.162576 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3564c89-a1c3-4fb9-a260-ee68c796bbe1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:20.163593 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3564c89-a1c3-4fb9-a260-ee68c796bbe1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:20.255386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a3564c89-a1c3-4fb9-a260-ee68c796bbe1 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105895 Aug 01 15:28:20.255997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 297/584] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:28:20 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:20.774866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:20.775521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:20.782416 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:20.783914 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:20.784873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:20.785311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:21.004129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:21.012459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cfb740e5-866c-487e-92fb-14d053fbd690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.241531 Aug 01 15:28:21.012988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 288/585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:20 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:21.319785 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-5b976aee-da4a-4437-b461-d3a2b25c7598 req-6cd9cbb2-975b-4065-9e95-115a055a7324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07157dfb-c02b-4928-9053-f93eed2ef8ef", "tag": "b896bca9-acf1-4e03-aed9-a817f5160dab"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:21.331333 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5b976aee-da4a-4437-b461-d3a2b25c7598 req-6cd9cbb2-975b-4065-9e95-115a055a7324 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:21.332152 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5b976aee-da4a-4437-b461-d3a2b25c7598 req-6cd9cbb2-975b-4065-9e95-115a055a7324 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:21.346240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-5b976aee-da4a-4437-b461-d3a2b25c7598 req-6cd9cbb2-975b-4065-9e95-115a055a7324 service nova] Creating event network-changed:b896bca9-acf1-4e03-aed9-a817f5160dab for instance 07157dfb-c02b-4928-9053-f93eed2ef8ef on hv-cinder-84713 Aug 01 15:28:21.351910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-5b976aee-da4a-4437-b461-d3a2b25c7598 req-6cd9cbb2-975b-4065-9e95-115a055a7324 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036240 Aug 01 15:28:21.352512 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 298/586] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:21.608243 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-77332cdc-dc3f-417a-a655-5e31184059ce req-670dfa99-fa29-470d-a0c1-00cb1b482b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8374677-0d2b-4e4e-9659-d6c32a495a28", "tag": "d353ebb5-f9f0-4ac5-928d-6377628e16cf"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:21.622475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-77332cdc-dc3f-417a-a655-5e31184059ce req-670dfa99-fa29-470d-a0c1-00cb1b482b0b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:21.623335 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-77332cdc-dc3f-417a-a655-5e31184059ce req-670dfa99-fa29-470d-a0c1-00cb1b482b0b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:21.636704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-77332cdc-dc3f-417a-a655-5e31184059ce req-670dfa99-fa29-470d-a0c1-00cb1b482b0b service nova] Creating event network-changed:d353ebb5-f9f0-4ac5-928d-6377628e16cf for instance a8374677-0d2b-4e4e-9659-d6c32a495a28 on hv-cinder-84713 Aug 01 15:28:21.642247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-77332cdc-dc3f-417a-a655-5e31184059ce req-670dfa99-fa29-470d-a0c1-00cb1b482b0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037599 Aug 01 15:28:21.643156 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 289/587] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:22.036274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:22.037356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:22.039495 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:22.045289 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:22.046108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:22.047493 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:22.048141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:22.212567 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:22.220882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1869bcd2-3996-42e8-ab06-01f4998ba765 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.189957 Aug 01 15:28:22.221724 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 299/588] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:22 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:23.172444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:23.173046 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:23.179704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:23.180160 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:23.181021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:23.181401 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:23.242247 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:23.242858 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:23.249932 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:23.250278 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:23.251127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:23.251523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:23.266070 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lazy-loading 'services' on Instance uuid 893c51ab-136f-410d-96f7-0cc474c99a36 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:23.341612 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1e1b2f70-ca21-45ef-96d9-16d4de560af0 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36/os-volume_attachments/05d7ba49-4e99-443a-98a7-69d2c5fc9efc" status: 202 len: 0 microversion: 2.1 time: 0.173835 Aug 01 15:28:23.342451 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 290/589] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:28:23 2022] DELETE /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36/os-volume_attachments/05d7ba49-4e99-443a-98a7-69d2c5fc9efc => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:28:23.367155 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-9382b203-d02d-4496-919f-e2967cfc9a01 req-e50dab83-32b2-4328-9c3a-7660ce76945a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07157dfb-c02b-4928-9053-f93eed2ef8ef", "tag": "b896bca9-acf1-4e03-aed9-a817f5160dab"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:23.377889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9382b203-d02d-4496-919f-e2967cfc9a01 req-e50dab83-32b2-4328-9c3a-7660ce76945a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:23.378398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-9382b203-d02d-4496-919f-e2967cfc9a01 req-e50dab83-32b2-4328-9c3a-7660ce76945a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:23.390084 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-9382b203-d02d-4496-919f-e2967cfc9a01 req-e50dab83-32b2-4328-9c3a-7660ce76945a service nova] Creating event network-changed:b896bca9-acf1-4e03-aed9-a817f5160dab for instance 07157dfb-c02b-4928-9053-f93eed2ef8ef on hv-cinder-84713 Aug 01 15:28:23.394538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:23.402458 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-058bfcda-a028-4713-ac49-39613b4bf1a5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.164326 Aug 01 15:28:23.402928 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 300/590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:23 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:23.408758 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-9382b203-d02d-4496-919f-e2967cfc9a01 req-e50dab83-32b2-4328-9c3a-7660ce76945a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044983 Aug 01 15:28:23.411339 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 291/591] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:24.430713 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:24.432231 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:24.442933 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:24.443526 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:24.449413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:24.449906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:24.665119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:24.676785 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3b01386e-1586-4dc0-841e-59e0fe4486fd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.251126 Aug 01 15:28:24.690346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 301/592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:24 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:25.579916 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:25.580462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:25.588912 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:25.589584 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:25.590913 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:25.591678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:25.623328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:28:25.697615 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:25.698577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:25.704869 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:25.705336 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:25.706277 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:25.706634 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:25.711092 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6020d2aa-20dd-4c99-944e-fafbf71d5164 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 204 len: 0 microversion: 2.1 time: 0.135367 Aug 01 15:28:25.711925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 292/593] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:28:25 2022] DELETE /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:28:25.721000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:25.721688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:25.728793 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:25.728989 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:25.729767 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:25.730237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:25.905283 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:25.913378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0dc32e54-db5f-4cb8-ba52-c2ce2aa63efe tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.219683 Aug 01 15:28:25.913994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 302/594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:25 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:25.923848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:25.931656 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-69e8da69-cb79-427a-af8c-f23055665a5a tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1513 microversion: 2.1 time: 0.215170 Aug 01 15:28:25.932265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 293/595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:25 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:26.935152 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:26.935758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:26.942785 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:26.943227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:26.943995 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:26.944424 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:26.952685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:26.953321 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:26.960656 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:26.961028 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:26.961811 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:26.962381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:27.146356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:27.151561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:27.154409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-af48b4ef-71bc-4f9e-87dd-2993fb3cb219 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.223291 Aug 01 15:28:27.154996 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 303/596] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:26 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:27.166484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ad7b137-3b67-415e-97f0-b0fc8911ea69 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1513 microversion: 2.1 time: 0.217599 Aug 01 15:28:27.167341 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 294/597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:26 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:28.181114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:28.182877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:28.187981 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:28.189188 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:28.190027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:28.190483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:28.191286 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:28.191721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:28.195947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:28.196371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:28.197112 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:28.197543 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:28.524200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:28.532610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:28.534586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4e623f28-057d-43f8-b761-b786b0d38d66 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1513 microversion: 2.1 time: 0.350415 Aug 01 15:28:28.539169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 295/598] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:28 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:28.542985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-045eae2f-a153-4f39-828d-d1344dae16d3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.368848 Aug 01 15:28:28.543753 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 304/599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:28 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:28.631526 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-906cc821-600c-45e5-8188-b9d5fc300648 req-5740f252-a4c3-4d5e-931e-bbbf2c748edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8374677-0d2b-4e4e-9659-d6c32a495a28", "name": "network-vif-plugged", "status": "completed", "tag": "d353ebb5-f9f0-4ac5-928d-6377628e16cf"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:28.636989 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:28.644260 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-906cc821-600c-45e5-8188-b9d5fc300648 req-5740f252-a4c3-4d5e-931e-bbbf2c748edd service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:28.644788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-906cc821-600c-45e5-8188-b9d5fc300648 req-5740f252-a4c3-4d5e-931e-bbbf2c748edd service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:28.658025 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-906cc821-600c-45e5-8188-b9d5fc300648 req-5740f252-a4c3-4d5e-931e-bbbf2c748edd service nova] Creating event network-vif-plugged:d353ebb5-f9f0-4ac5-928d-6377628e16cf for instance a8374677-0d2b-4e4e-9659-d6c32a495a28 on hv-cinder-84713 Aug 01 15:28:28.664748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-906cc821-600c-45e5-8188-b9d5fc300648 req-5740f252-a4c3-4d5e-931e-bbbf2c748edd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036601 Aug 01 15:28:28.665508 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 296/600] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:28:28.848733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-38889e51-82ad-46bc-8286-20c609e0740a req-fe588031-a147-4ddc-af3b-d25005fdea4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893c51ab-136f-410d-96f7-0cc474c99a36", "name": "network-vif-deleted", "tag": "acd9b96a-3959-4d8c-8e08-37e0a86df34c"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:28.859445 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38889e51-82ad-46bc-8286-20c609e0740a req-fe588031-a147-4ddc-af3b-d25005fdea4a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:28.859985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38889e51-82ad-46bc-8286-20c609e0740a req-fe588031-a147-4ddc-af3b-d25005fdea4a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:28.883031 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-38889e51-82ad-46bc-8286-20c609e0740a req-fe588031-a147-4ddc-af3b-d25005fdea4a service nova] Creating event network-vif-deleted:acd9b96a-3959-4d8c-8e08-37e0a86df34c for instance 893c51ab-136f-410d-96f7-0cc474c99a36 on hv-cinder-84713 Aug 01 15:28:28.888239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-38889e51-82ad-46bc-8286-20c609e0740a req-fe588031-a147-4ddc-af3b-d25005fdea4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046852 Aug 01 15:28:28.888835 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 305/601] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:29.559509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:29.560206 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:29.564273 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:29.564998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:29.567233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:29.567710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:29.568486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:29.568920 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:29.571904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:29.572353 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:29.573111 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:29.573541 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:29.585202 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:29.595012 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:29.614770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:29.615421 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:29.615887 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lazy-loading 'fault' on Instance uuid 893c51ab-136f-410d-96f7-0cc474c99a36 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:29.680394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:29.688261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-fc79e7f2-020b-46ba-b655-2e9c58ad6682 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 200 len: 1309 microversion: 2.1 time: 0.133592 Aug 01 15:28:29.688813 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 297/602] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:29 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 1309 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:29.738409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:29.746303 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3b0831c-855c-4305-be1c-1c7a4fa3d244 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1366 microversion: 2.1 time: 0.186259 Aug 01 15:28:29.746886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 306/603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:29 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:30.710894 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:30.711517 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 893c51ab-136f-410d-96f7-0cc474c99a36] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:30.719731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:30.720182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:30.721103 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:30.721533 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:30.738627 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] HTTP exception thrown: Instance 893c51ab-136f-410d-96f7-0cc474c99a36 could not be found. Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Request method failure captured: Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 HTTP/1.1 Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_DRb8mblEGOAJDlcvfAN86g33tSxxikNcSxQ_Exwm_8lVI2Z-_Cof-8gi43KheFGTeg931hgqUFcPip3j5cYlueKSy14ycKUpBxH6oPSiPkNFgYjlgK2E37V2TrDqhAR63OXM_UqHhEs4Qiq7e9VtSgyLlr2YvdCw3S9BCe92XnzSY Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: dc512d8e2ab848fda424f9eeb6c816c9 Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712758365 Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:28:30.740278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc512d8e2ab848fda424f9eeb6c816c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc512d8e2ab848fda424f9eeb6c816c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc512d8e2ab848fda424f9eeb6c816c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc512d8e2ab848fda424f9eeb6c816c9"}]}] Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotTestJSON-712758365 Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: dc512d8e2ab848fda424f9eeb6c816c9 Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712758365 Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotTestJSON-712758365-project Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: b1afe2bda6784f9987b8aa5fa174dde2 Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotTestJSON-712758365-project Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 893c51ab-136f-410d-96f7-0cc474c99a36 could not be found. Aug 01 15:28:30.741947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '893c51ab-136f-410d-96f7-0cc474c99a36'} Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893c51ab-136f-410d-96f7-0cc474c99a36 could not be found. Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:28:30.742959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893c51ab-136f-410d-96f7-0cc474c99a36 could not be found. Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893c51ab-136f-410d-96f7-0cc474c99a36 could not be found. Aug 01 15:28:30.744379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:30.746252 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Returning 404 to user: Instance 893c51ab-136f-410d-96f7-0cc474c99a36 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:28:30.746252 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9855aa31-209e-4bb9-af02-fbcaba0cb6bf tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36" status: 404 len: 111 microversion: 2.1 time: 0.035707 Aug 01 15:28:30.746252 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 298/604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:30 2022] GET /compute/v2.1/servers/893c51ab-136f-410d-96f7-0cc474c99a36 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:28:30.778436 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:30.779151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:30.786090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:30.786561 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:30.787309 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:30.787740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:30.929336 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:30.939752 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b47a707-34d3-4fb1-9f01-02e0a0bea821 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1556 microversion: 2.1 time: 0.165471 Aug 01 15:28:30.940411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 307/605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:30 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:30.965492 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1bc7efe2-5cf5-4f05-ba3f-f5fafaa60bc7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:30.966351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1bc7efe2-5cf5-4f05-ba3f-f5fafaa60bc7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:30.974395 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bc7efe2-5cf5-4f05-ba3f-f5fafaa60bc7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:30.974838 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bc7efe2-5cf5-4f05-ba3f-f5fafaa60bc7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:30.975639 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bc7efe2-5cf5-4f05-ba3f-f5fafaa60bc7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:30.976066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1bc7efe2-5cf5-4f05-ba3f-f5fafaa60bc7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:31.058216 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1bc7efe2-5cf5-4f05-ba3f-f5fafaa60bc7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099337 Aug 01 15:28:31.058918 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 299/606] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:28:30 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:28:32.064058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a4cb31c0-96b0-47fc-b2c3-441be93ee4c3 req-731547b8-f96a-4751-aaaf-6486c8c6028d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8374677-0d2b-4e4e-9659-d6c32a495a28", "tag": "d353ebb5-f9f0-4ac5-928d-6377628e16cf"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:32.075186 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a4cb31c0-96b0-47fc-b2c3-441be93ee4c3 req-731547b8-f96a-4751-aaaf-6486c8c6028d service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:32.075698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a4cb31c0-96b0-47fc-b2c3-441be93ee4c3 req-731547b8-f96a-4751-aaaf-6486c8c6028d service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:32.088302 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a4cb31c0-96b0-47fc-b2c3-441be93ee4c3 req-731547b8-f96a-4751-aaaf-6486c8c6028d service nova] Creating event network-changed:d353ebb5-f9f0-4ac5-928d-6377628e16cf for instance a8374677-0d2b-4e4e-9659-d6c32a495a28 on hv-cinder-84713 Aug 01 15:28:32.093448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a4cb31c0-96b0-47fc-b2c3-441be93ee4c3 req-731547b8-f96a-4751-aaaf-6486c8c6028d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033011 Aug 01 15:28:32.094085 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 308/607] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:28:35.958500 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f17073db-be8e-405c-bb23-2c1acbf7c35f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:35.959076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f17073db-be8e-405c-bb23-2c1acbf7c35f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:35.967668 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f17073db-be8e-405c-bb23-2c1acbf7c35f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:35.968289 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f17073db-be8e-405c-bb23-2c1acbf7c35f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:35.969116 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f17073db-be8e-405c-bb23-2c1acbf7c35f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:35.969548 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f17073db-be8e-405c-bb23-2c1acbf7c35f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:36.004077 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f17073db-be8e-405c-bb23-2c1acbf7c35f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments/fb028a05-b9e6-43f5-a9c4-d717070edb96" status: 200 len: 194 microversion: 2.20 time: 0.050666 Aug 01 15:28:36.004680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 300/608] 10.222.0.48 () {60 vars in 1454 bytes} [Mon Aug 1 15:28:35 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments/fb028a05-b9e6-43f5-a9c4-d717070edb96 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:36.088435 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:36.089032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:36.095933 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:36.096379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:36.097165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:36.097599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:36.191954 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lazy-loading 'services' on Instance uuid 7b57efc3-5810-4f01-9863-c16ab9dba00f {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:36.279047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-176c123c-aa0c-4468-a6a3-88558c2b7d13 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments/fb028a05-b9e6-43f5-a9c4-d717070edb96" status: 202 len: 0 microversion: 2.20 time: 0.194960 Aug 01 15:28:36.279694 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 309/609] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 1 15:28:36 2022] DELETE /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments/fb028a05-b9e6-43f5-a9c4-d717070edb96 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:28:36.288433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-97bb348d-81d2-45da-8569-6b132c4c1484 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:36.290664 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-97bb348d-81d2-45da-8569-6b132c4c1484 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:36.297430 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bb348d-81d2-45da-8569-6b132c4c1484 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:36.298066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bb348d-81d2-45da-8569-6b132c4c1484 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:36.298986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bb348d-81d2-45da-8569-6b132c4c1484 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:36.299532 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-97bb348d-81d2-45da-8569-6b132c4c1484 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:36.345195 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-97bb348d-81d2-45da-8569-6b132c4c1484 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060750 Aug 01 15:28:36.346106 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 301/610] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 15:28:36 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:37.362816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a52914d4-4083-4ef6-bed0-9fca4bf8b530 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:37.365296 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a52914d4-4083-4ef6-bed0-9fca4bf8b530 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:37.372676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52914d4-4083-4ef6-bed0-9fca4bf8b530 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:37.373148 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52914d4-4083-4ef6-bed0-9fca4bf8b530 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:37.374008 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52914d4-4083-4ef6-bed0-9fca4bf8b530 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:37.374473 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52914d4-4083-4ef6-bed0-9fca4bf8b530 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:37.406616 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a52914d4-4083-4ef6-bed0-9fca4bf8b530 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050286 Aug 01 15:28:37.407182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 310/611] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 15:28:37 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:38.420896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-722e1f80-c973-4140-87e7-32a63bcc2f65 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:38.422955 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-722e1f80-c973-4140-87e7-32a63bcc2f65 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:38.435071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-722e1f80-c973-4140-87e7-32a63bcc2f65 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:38.435588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-722e1f80-c973-4140-87e7-32a63bcc2f65 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:38.436367 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-722e1f80-c973-4140-87e7-32a63bcc2f65 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:38.436844 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-722e1f80-c973-4140-87e7-32a63bcc2f65 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:38.469278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-722e1f80-c973-4140-87e7-32a63bcc2f65 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052557 Aug 01 15:28:38.469875 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 302/612] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 15:28:38 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:39.483512 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f01c6c5c-e161-4f4d-a445-448c64b79b75 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:39.485903 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f01c6c5c-e161-4f4d-a445-448c64b79b75 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:39.493075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f01c6c5c-e161-4f4d-a445-448c64b79b75 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:39.493502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f01c6c5c-e161-4f4d-a445-448c64b79b75 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:39.494329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f01c6c5c-e161-4f4d-a445-448c64b79b75 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:39.494764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f01c6c5c-e161-4f4d-a445-448c64b79b75 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:39.528528 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f01c6c5c-e161-4f4d-a445-448c64b79b75 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050175 Aug 01 15:28:39.529347 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 311/613] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 15:28:39 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:28:40.544245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a55adeed-65ff-45cc-83fd-f067a04c1143 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:40.547231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a55adeed-65ff-45cc-83fd-f067a04c1143 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:40.554544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a55adeed-65ff-45cc-83fd-f067a04c1143 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:40.554992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a55adeed-65ff-45cc-83fd-f067a04c1143 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:40.555749 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a55adeed-65ff-45cc-83fd-f067a04c1143 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:40.556179 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a55adeed-65ff-45cc-83fd-f067a04c1143 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:40.586010 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a55adeed-65ff-45cc-83fd-f067a04c1143 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048078 Aug 01 15:28:40.586561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 303/614] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 15:28:40 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:40.656938 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:40.657428 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:40.664384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:40.664970 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:40.665842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:40.666378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:40.688381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1002149972", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "networks": [{"uuid": "6763ac8e-2b02-41c6-89a1-605e1a566a14"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:40.692437 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:28:40.741278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] validate_networks() for [('6763ac8e-2b02-41c6-89a1-605e1a566a14', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:28:40.771709 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-68dd3921-e1a1-4173-924c-3129ec23f58d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 204 len: 0 microversion: 2.20 time: 0.118608 Aug 01 15:28:40.772325 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 312/615] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 15:28:40 2022] DELETE /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:28:40.781823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:40.782846 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:40.789658 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:40.790155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:40.791008 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:40.791539 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:40.992080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:41.000787 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:41.002311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:41.003526 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eb96d38a-db67-4fcf-bd33-ae7a2359df6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.226552 Aug 01 15:28:41.004095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 313/616] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:40 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:41.173639 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:28:41.174095 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:28:41.174563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:28:41.174961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:28:41.175374 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:28:41.184952 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:41.185422 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:41.186247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:41.186675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:41.203915 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Getting quotas for project dc512d8e2ab848fda424f9eeb6c816c9. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:41.208381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Getting quotas for user b1afe2bda6784f9987b8aa5fa174dde2 and project dc512d8e2ab848fda424f9eeb6c816c9. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:41.219632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:28:41.221954 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:28:41.269651 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-970a720b-1c71-4e33-90e1-5d1dc84e9a4c tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585153 Aug 01 15:28:41.270461 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 304/617] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:28:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:28:41.281570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00a972db-282d-44ed-a2f5-c8395c843921 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:41.282230 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00a972db-282d-44ed-a2f5-c8395c843921 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:41.335696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00a972db-282d-44ed-a2f5-c8395c843921 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:41.343070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00a972db-282d-44ed-a2f5-c8395c843921 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1219 microversion: 2.1 time: 0.065259 Aug 01 15:28:41.343943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 314/618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:41 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:42.027283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:42.027872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:42.034735 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:42.035182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:42.035942 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:42.036374 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:42.176731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:42.185271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:42.186851 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:42.188097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d35f5df-353c-40f4-b722-d271ea9f2f05 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.165337 Aug 01 15:28:42.188646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 305/619] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:42 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:42.367188 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:42.368174 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:42.377329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:42.377768 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:42.378567 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:42.378996 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:42.448980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:42.459579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8da21348-fb5d-4409-aba7-bdffc31f5829 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1223 microversion: 2.1 time: 0.097620 Aug 01 15:28:42.460483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 315/620] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:42 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:43.213067 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:43.213849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:43.233023 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:43.237137 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:43.238051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:43.238499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:43.483343 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:43.484033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:43.491327 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:43.492053 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:43.493128 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:43.493559 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:43.588274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:43.598334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-de0f73af-13b3-42cf-a071-cc03a1a78216 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1277 microversion: 2.1 time: 0.118296 Aug 01 15:28:43.599652 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 316/621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:43 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:43.601295 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:43.611474 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:43.612718 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:43.614161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f24cb7e0-6859-4c51-a444-538241def022 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1724 microversion: 2.20 time: 0.406365 Aug 01 15:28:43.615242 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 306/622] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:43 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:44.224132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-cf6701f2-b667-41ae-8e3d-75fa689dbb51 req-2320609a-344b-42e6-bdb0-4d19f8f56658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b57efc3-5810-4f01-9863-c16ab9dba00f", "name": "network-vif-deleted", "tag": "1fafaa48-a913-4b85-9a2b-22a5748ea906"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:44.237478 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cf6701f2-b667-41ae-8e3d-75fa689dbb51 req-2320609a-344b-42e6-bdb0-4d19f8f56658 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.238203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cf6701f2-b667-41ae-8e3d-75fa689dbb51 req-2320609a-344b-42e6-bdb0-4d19f8f56658 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.254761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-cf6701f2-b667-41ae-8e3d-75fa689dbb51 req-2320609a-344b-42e6-bdb0-4d19f8f56658 service nova] Creating event network-vif-deleted:1fafaa48-a913-4b85-9a2b-22a5748ea906 for instance 7b57efc3-5810-4f01-9863-c16ab9dba00f on hv-cinder-84713 Aug 01 15:28:44.261206 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-cf6701f2-b667-41ae-8e3d-75fa689dbb51 req-2320609a-344b-42e6-bdb0-4d19f8f56658 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040476 Aug 01 15:28:44.266799 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 317/623] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:44.621183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:44.622043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:44.628770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.629326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.630182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.630848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.641228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:44.642768 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:44.656314 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.656917 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.657742 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.658258 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.698129 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.698837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.699476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lazy-loading 'fault' on Instance uuid 7b57efc3-5810-4f01-9863-c16ab9dba00f {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:28:44.808108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:44.825673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:44.827301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:44.828715 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90676818-a7c4-4548-9427-65ab906afdd1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 200 len: 1371 microversion: 2.20 time: 0.194677 Aug 01 15:28:44.837956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 318/624] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:44 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:44.837956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:44.837956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:44.847271 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.847722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.848507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.849118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.876302 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:28:44.908501 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:44.916749 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e35b0981-b046-4041-90f8-1cb4b461f9cd tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.299840 Aug 01 15:28:44.918258 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 307/625] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:44 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:44.972478 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bba4961b-31b5-4def-b26d-2d5666584ccb tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 204 len: 0 microversion: 2.1 time: 0.141764 Aug 01 15:28:44.973607 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 319/626] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:28:44 2022] DELETE /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:28:44.982834 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:44.983935 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:44.991238 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.991963 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:44.992964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:44.993914 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:45.195686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:45.205145 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3b127b75-71ea-4c9d-9549-9561842bff92 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1577 microversion: 2.1 time: 0.226567 Aug 01 15:28:45.208173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-9193d654-d18d-4874-8c60-0a2146865f3d req-6f48c941-6209-4e6f-846c-25a1b8b4e4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936bab3c-e55e-452b-ab78-367e9b0669cd", "tag": "c3beecfd-7a2f-4a20-abf7-0ca5a0a67d3a"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:45.218878 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 308/627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:44 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:45.222836 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-9193d654-d18d-4874-8c60-0a2146865f3d req-6f48c941-6209-4e6f-846c-25a1b8b4e4d1 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:45.223261 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-9193d654-d18d-4874-8c60-0a2146865f3d req-6f48c941-6209-4e6f-846c-25a1b8b4e4d1 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:45.237196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-9193d654-d18d-4874-8c60-0a2146865f3d req-6f48c941-6209-4e6f-846c-25a1b8b4e4d1 service nova] Creating event network-changed:c3beecfd-7a2f-4a20-abf7-0ca5a0a67d3a for instance 936bab3c-e55e-452b-ab78-367e9b0669cd on hv-cinder-84713 Aug 01 15:28:45.242453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-9193d654-d18d-4874-8c60-0a2146865f3d req-6f48c941-6209-4e6f-846c-25a1b8b4e4d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042946 Aug 01 15:28:45.243584 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 320/628] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:45.854003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:45.854687 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:45.862331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:45.862780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:45.863528 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:45.863987 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:45.878808 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] HTTP exception thrown: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Request method failure captured: Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f HTTP/1.1 Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AOLKgLDJ-pxz0u8H8vyrO8CBE9I7Qpk7eFdim0YXde0ivlp2qkXfFV4SbkJl4k0Hycxe0WdAKvXfenAvC6hR6teih0EaKbio7tFgQ5F5J64eHXPNODMeHnKIMPX9AdQfKWHW2rsRC9ynXy2-L8eCAn_tC_S28gNTDrobw6vryDxhU Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:28:45.880384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5400c4df102f43398a278247c4431ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5400c4df102f43398a278247c4431ef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}] Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: c60ee64ca18e4930a14e3e17bc979ff7 Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:28:45.882021 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '7b57efc3-5810-4f01-9863-c16ab9dba00f'} Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:28:45.883575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:28:45.885043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:45.886296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Returning 404 to user: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:28:45.886296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2bfbf63d-55d3-4379-9486-556117abc813 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 404 len: 111 microversion: 2.20 time: 0.031756 Aug 01 15:28:45.886296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 309/629] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:45 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:28:45.892707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-efe1cf52-8164-4955-9e09-2b00455b403b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '.version_select at 0x7f0367399b80>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:45.915226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-efe1cf52-8164-4955-9e09-2b00455b403b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720865712" status: 204 len: 0 microversion: 2.20 time: 0.027734 Aug 01 15:28:45.915843 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 321/630] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Aug 1 15:28:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720865712 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:28:45.938408 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:45.939033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:45.945394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:45.945829 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:45.946570 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:45.946992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:46.149442 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:46.159154 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f1931a8-65cf-42cc-b519-9070a3a2e43e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.224563 Aug 01 15:28:46.168789 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 310/631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:45 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:46.230398 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:46.231269 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:46.238402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:46.238937 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:46.239794 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:46.240290 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:46.506029 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:46.510581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:46.516463 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d5066938-7b9b-4312-8a91-4bdcd7f12c68 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1577 microversion: 2.1 time: 0.291133 Aug 01 15:28:46.532616 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 322/632] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:46 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1577 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:46.741544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-62611e17-6e32-44d1-97dd-ede15ce0ed7f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'create', calling method: .version_select at 0x7f03672c59d0>, body: {"keypair": {"name": "tempest-keypair-593963452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2ZUFBdmyAKEgPboFwKfH0EkzLVQXKh+b6xgB1evsbT2srpOqxiZ8uTL8ldPg3Tb7dHlbWLum1krbmQODJdGhzHlqxAU2gx2L9KA5xxpA0eKwV49h/yps9wnQKo3ykJUA=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:46.757965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-62611e17-6e32-44d1-97dd-ede15ce0ed7f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for project 5400c4df102f43398a278247c4431ef6. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:46.763090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-62611e17-6e32-44d1-97dd-ede15ce0ed7f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for user c60ee64ca18e4930a14e3e17bc979ff7 and project 5400c4df102f43398a278247c4431ef6. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:46.792707 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-62611e17-6e32-44d1-97dd-ede15ce0ed7f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055062 Aug 01 15:28:46.793755 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 311/633] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 1 15:28:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 01 15:28:47.186236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:47.186236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:47.192244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:47.192800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:47.193648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:47.194195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:47.458272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:47.469210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6737f488-aa20-47b7-abe0-507fa159e53f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.292241 Aug 01 15:28:47.470059 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 323/634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:47 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:47.541032 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:47.541921 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:47.549309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:47.550514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:47.551879 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:47.552463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:47.833284 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:47.842634 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d5ce643a-b6d5-44dc-9b0f-d8afc21f093c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1577 microversion: 2.1 time: 0.305669 Aug 01 15:28:47.843216 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 312/635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:47 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1577 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:47.942197 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-acf60a1f-0448-41b2-beae-4d02c122a74e req-92478db3-b208-403f-855c-eaa36613ff96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e", "name": "network-vif-deleted", "tag": "c68be1f7-d774-45ae-ae98-631e16953453"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:47.952082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-acf60a1f-0448-41b2-beae-4d02c122a74e req-92478db3-b208-403f-855c-eaa36613ff96 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:47.952554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-acf60a1f-0448-41b2-beae-4d02c122a74e req-92478db3-b208-403f-855c-eaa36613ff96 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:47.966081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-acf60a1f-0448-41b2-beae-4d02c122a74e req-92478db3-b208-403f-855c-eaa36613ff96 service nova] Creating event network-vif-deleted:c68be1f7-d774-45ae-ae98-631e16953453 for instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e on hv-cinder-84713 Aug 01 15:28:47.972644 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-acf60a1f-0448-41b2-beae-4d02c122a74e req-92478db3-b208-403f-855c-eaa36613ff96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Aug 01 15:28:47.973927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 324/636] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:28:48.492009 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:48.492728 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:48.499253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:48.499687 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:48.500722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:48.501493 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:48.585927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-397013550", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6ed9b57-cd47-49a1-bf4f-b2ec5a3241c0"}], "security_groups": [{"name": "tempest-securitygroup--176267046"}], "key_name": "tempest-keypair-593963452", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:48.649511 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:48.658230 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff0b8ea7-a829-46a7-8b47-59c07271770e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.171125 Aug 01 15:28:48.658919 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 313/637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:48 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:48.697093 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] validate_networks() for [('f6ed9b57-cd47-49a1-bf4f-b2ec5a3241c0', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:28:48.864522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:48.865155 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:48.873188 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:48.876861 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:48.880114 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:48.880905 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:48.986257 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:48.994577 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9e109a4c-cc9a-4704-8953-1b5d1241f97a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 200 len: 1509 microversion: 2.1 time: 0.134047 Aug 01 15:28:48.995161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 314/638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:48 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 1509 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:49.119495 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:28:49.119919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:28:49.120390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:28:49.120986 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:28:49.121400 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:28:49.131220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:49.131667 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:49.132494 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:49.132928 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:49.150980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for project 5400c4df102f43398a278247c4431ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:49.155342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Getting quotas for user c60ee64ca18e4930a14e3e17bc979ff7 and project 5400c4df102f43398a278247c4431ef6. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:49.167607 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:28:49.170034 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:28:49.228030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27d3ee7d-86f2-4ddb-80d4-affd10eb334d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.648976 Aug 01 15:28:49.230091 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 325/639] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 1 15:28:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 01 15:28:49.248016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-38515085-608d-456d-b411-1a9f070890a4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:49.248646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-38515085-608d-456d-b411-1a9f070890a4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:49.319139 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38515085-608d-456d-b411-1a9f070890a4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:49.327945 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38515085-608d-456d-b411-1a9f070890a4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:49.329456 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38515085-608d-456d-b411-1a9f070890a4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:49.330663 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-38515085-608d-456d-b411-1a9f070890a4 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1280 microversion: 2.20 time: 0.087323 Aug 01 15:28:49.331234 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 315/640] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:49 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:49.681524 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:49.682306 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:49.698285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:49.698731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:49.699496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:49.699929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:49.850300 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:49.858445 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-beb136f6-e739-4151-ab55-4be6a8594e93 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.182503 Aug 01 15:28:49.859018 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 326/641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:49 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:50.017071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:50.017676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:50.025675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.026155 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:50.026930 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.027367 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:50.040947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] HTTP exception thrown: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Request method failure captured: Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e HTTP/1.1 Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_BV6ZqrsYBM03njtbd1zIqIZT8qUanRWK-0IGHT72ncl9bzVO6lAnn10sJkog-7jKURPByoyEpm-2D0I3kpdrj9Y_T5J-ldyDgNjnfxU__5LFBUqkU3cSpbS9ZkcKjmI9_tvYLDcoehlTuaQHGA_Dgss0MU209rx8vlWKHlrLI1_VQ Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:28:50.042525 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/97f413eea3b945cc843040b11d501993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_97f413eea3b945cc843040b11d501993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}] Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 0898fda8be3743f093dbb216f21eb931 Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:28:50.044063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e'} Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:28:50.044964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:28:50.046503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:28:50.047781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Returning 404 to user: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:28:50.047781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b26d6129-1c87-4cb6-9ab6-ba82a49af562 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 404 len: 111 microversion: 2.1 time: 0.030868 Aug 01 15:28:50.047781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 316/642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:50 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:28:50.150316 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1547908133", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2087018318", "security_groups": [{"name": "tempest-secgroup-smoke-2024196989"}], "block_device_mapping_v2": [{"uuid": "a32fa661-1d12-401c-afcc-e3dbf08c74b6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cde6e32b-9ffe-4036-ade9-45f54f08a2da"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:50.272632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] validate_networks() for [('cde6e32b-9ffe-4036-ade9-45f54f08a2da', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:28:50.353998 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:50.354860 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:50.361418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.361889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:50.362649 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.363062 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:50.434625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:50.443418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:50.444947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:50.446048 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4bc2b537-24b7-4902-bd20-109341fb0740 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1340 microversion: 2.20 time: 0.096113 Aug 01 15:28:50.446616 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 317/643] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:50 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:28:50.746191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:28:50.747346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:28:50.747999 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:28:50.748682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:28:50.749307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:28:50.762675 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.763113 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:50.764455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.765044 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:50.785979 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for project 97f413eea3b945cc843040b11d501993. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:28:50.792486 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for user 0898fda8be3743f093dbb216f21eb931 and project 97f413eea3b945cc843040b11d501993. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:28:50.796248 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:50.862992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:28:50.864767 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a32fa661-1d12-401c-afcc-e3dbf08c74b6',volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:28:50.879626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:50.881287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:50.889154 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.889732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:50.890714 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:50.891332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:51.009877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc832a62-cf21-4167-8b74-ff68268c694a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.863547 Aug 01 15:28:51.016360 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 327/644] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:28:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:28:51.021892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f2bdac5a-5ffb-45be-b05b-30ca840d4d15 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:51.022527 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f2bdac5a-5ffb-45be-b05b-30ca840d4d15 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:51.047805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:51.053895 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.056625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9d6aa43c-c445-4e36-b403-fdcfa1e26ac6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.181834 Aug 01 15:28:51.057204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 318/645] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:50 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:51.080520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f2bdac5a-5ffb-45be-b05b-30ca840d4d15 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:51.087733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f2bdac5a-5ffb-45be-b05b-30ca840d4d15 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1095 microversion: 2.1 time: 0.069790 Aug 01 15:28:51.088780 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 328/646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:51 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:51.471467 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:51.472798 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:51.479459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:28:51.486730 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:51.487658 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:51.489079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:51.490409 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:51.574605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:51.583783 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:51.586013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:51.587151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7820484a-5977-445d-a582-545866e76b61 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1338 microversion: 2.20 time: 0.122158 Aug 01 15:28:51.587964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 319/647] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:51 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1338 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:52.081725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:52.084293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:52.097441 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:52.098750 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:52.101090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:52.102272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:52.110497 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:52.111359 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:52.120816 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:52.121268 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:52.122117 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:52.122554 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:52.555406 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:52.565137 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f7f5cbb8-658a-4c0d-b9e9-ddb2e65094d3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1201 microversion: 2.1 time: 0.459836 Aug 01 15:28:52.574847 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 320/648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:52 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1201 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:52.613809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:52.617558 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:52.628464 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:52.629305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:52.630334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:52.631071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:52.744788 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:52.764499 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45d97100-455f-4f5a-823f-a0e0c73f52e6 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.689704 Aug 01 15:28:52.772288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 329/649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:52 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:52.901545 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-ca77b177-eda7-4693-8353-6923d0338e7c req-606b70db-765a-4d4b-b40c-3b6a18c7accf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936bab3c-e55e-452b-ab78-367e9b0669cd", "name": "network-vif-plugged", "status": "completed", "tag": "c3beecfd-7a2f-4a20-abf7-0ca5a0a67d3a"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:52.940980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ca77b177-eda7-4693-8353-6923d0338e7c req-606b70db-765a-4d4b-b40c-3b6a18c7accf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:52.941587 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ca77b177-eda7-4693-8353-6923d0338e7c req-606b70db-765a-4d4b-b40c-3b6a18c7accf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:52.978709 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-ca77b177-eda7-4693-8353-6923d0338e7c req-606b70db-765a-4d4b-b40c-3b6a18c7accf service nova] Creating event network-vif-plugged:c3beecfd-7a2f-4a20-abf7-0ca5a0a67d3a for instance 936bab3c-e55e-452b-ab78-367e9b0669cd on hv-cinder-84713 Aug 01 15:28:52.983506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-ca77b177-eda7-4693-8353-6923d0338e7c req-606b70db-765a-4d4b-b40c-3b6a18c7accf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093391 Aug 01 15:28:52.984490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 330/650] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:52.992548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a68b0166-1365-42d3-b38c-11336242b48f req-8d3dd9d8-41ac-4875-91d3-7c5692f15c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c295d39-1434-4597-a68a-a46cea5899f9", "tag": "e0b42de4-84fd-4819-a551-2256b22587ca"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:53.006509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:53.009136 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a68b0166-1365-42d3-b38c-11336242b48f req-8d3dd9d8-41ac-4875-91d3-7c5692f15c88 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:53.011305 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a68b0166-1365-42d3-b38c-11336242b48f req-8d3dd9d8-41ac-4875-91d3-7c5692f15c88 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:53.027573 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a68b0166-1365-42d3-b38c-11336242b48f req-8d3dd9d8-41ac-4875-91d3-7c5692f15c88 service nova] Creating event network-changed:e0b42de4-84fd-4819-a551-2256b22587ca for instance 1c295d39-1434-4597-a68a-a46cea5899f9 on hv-cinder-84713 Aug 01 15:28:53.030240 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:53.032929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a68b0166-1365-42d3-b38c-11336242b48f req-8d3dd9d8-41ac-4875-91d3-7c5692f15c88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046879 Aug 01 15:28:53.034141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 331/651] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:53.037151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:53.048448 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1c3924e2-bca5-47fd-ac22-de65c13bb049 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1405 microversion: 2.20 time: 0.439332 Aug 01 15:28:53.049721 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 321/652] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:52 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:53.591670 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:53.592556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:53.601350 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:53.602103 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:53.602919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:53.603398 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:53.791681 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:53.792311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:53.801744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:53.802276 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:53.803122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:53.803561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:53.939739 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:53.947581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd35f59d-583b-4c1d-88fc-6ee3adbad7e4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.362831 Aug 01 15:28:53.948179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 332/653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:53 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:54.008429 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:54.016233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-49375f37-96f0-48fb-8ef2-c8d5f5b3e31e tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.229076 Aug 01 15:28:54.016797 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 322/654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:53 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:54.084830 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:54.085460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:54.091763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:54.092214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:54.093060 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:54.093422 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:54.227483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:54.236702 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:54.238235 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:54.239350 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96e40914-5ba5-422a-8bf7-20573848689f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1405 microversion: 2.20 time: 0.159610 Aug 01 15:28:54.239906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 333/655] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:54 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:54.970852 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:54.971470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:54.978475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:54.978921 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:54.979681 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:54.980107 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:55.036964 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:55.037684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:55.044628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:55.045047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:55.045891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:55.046313 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:55.163734 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:55.171646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a0852040-5943-4543-8ee8-d3e2f2c9750b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.204771 Aug 01 15:28:55.172229 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 323/656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:54 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:55.210145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:55.218047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8398603-896c-4b2c-a945-1d5b0517488f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.184996 Aug 01 15:28:55.218652 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 334/657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:55 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:55.262473 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:55.263069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:55.269277 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:55.269715 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:55.270507 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:55.270930 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:55.409599 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:55.419242 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:55.420803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:55.421952 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1293cbe-2ebe-4ccd-a511-5cfe1657540a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1405 microversion: 2.20 time: 0.163480 Aug 01 15:28:55.422513 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 324/658] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:55 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:56.152934 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-3216d13e-ef88-4b87-8979-5f5906ca37bc req-cf57dbb5-a0cd-4fb5-995d-ad33b7c0f8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b501c28-26be-4cb3-a318-b04537a639b6", "tag": "843a5381-9438-4fea-9e56-3350e9f962c1"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:56.166024 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3216d13e-ef88-4b87-8979-5f5906ca37bc req-cf57dbb5-a0cd-4fb5-995d-ad33b7c0f8bf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:56.166455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3216d13e-ef88-4b87-8979-5f5906ca37bc req-cf57dbb5-a0cd-4fb5-995d-ad33b7c0f8bf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:56.177545 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-3216d13e-ef88-4b87-8979-5f5906ca37bc req-cf57dbb5-a0cd-4fb5-995d-ad33b7c0f8bf service nova] Creating event network-changed:843a5381-9438-4fea-9e56-3350e9f962c1 for instance 8b501c28-26be-4cb3-a318-b04537a639b6 on hv-cinder-84713 Aug 01 15:28:56.182130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-3216d13e-ef88-4b87-8979-5f5906ca37bc req-cf57dbb5-a0cd-4fb5-995d-ad33b7c0f8bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036494 Aug 01 15:28:56.182698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 335/659] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:56.197492 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:56.198168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:56.206412 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:56.206869 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:56.207989 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:56.208418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:56.238941 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:56.239551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:56.246127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:56.246576 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:56.247334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:56.247751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:56.444720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:56.455962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f86c69e-f7cd-4167-856e-118033c7fd1f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.265766 Aug 01 15:28:56.457133 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 325/660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:56 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:56.463254 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:56.463875 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:56.470495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:56.471164 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:56.472111 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:56.472537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:56.534252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:56.542940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-66ae0134-b7c7-479b-9b93-fef87f26f670 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1319 microversion: 2.1 time: 0.308510 Aug 01 15:28:56.543527 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 336/661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:56 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:56.805150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:56.814637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:56.816080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:56.817213 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2952eeba-2335-48dd-b479-07ede84567fc tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1405 microversion: 2.20 time: 0.358300 Aug 01 15:28:56.817771 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 326/662] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:56 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1405 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:28:57.478618 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:57.479191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:57.486307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.486726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:57.487503 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.487992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:57.565227 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:57.566329 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:57.576244 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.576728 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:57.577564 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.578027 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:57.802950 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:57.811292 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0d7b6b2-7535-497f-9ce3-d144e170c6cd tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.336866 Aug 01 15:28:57.811960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 337/663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:57 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:57.844966 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:57.846650 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:57.851806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:57.854054 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.854764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:57.855674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.856113 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:57.869893 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a1dfd3ec-585c-4d12-949e-5c498e1228c4 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1507 microversion: 2.1 time: 0.309711 Aug 01 15:28:57.870519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 327/664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:57 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:28:57.892271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7490f14e-9980-468c-8c5a-f7a048b2492d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d95d43e4-3df5-4f5e-9ea6-c0cffc47a24d", "device": "/dev/sdb"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:57.895585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7490f14e-9980-468c-8c5a-f7a048b2492d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:57.903469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7490f14e-9980-468c-8c5a-f7a048b2492d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.904007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7490f14e-9980-468c-8c5a-f7a048b2492d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:57.904946 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7490f14e-9980-468c-8c5a-f7a048b2492d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:57.905581 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7490f14e-9980-468c-8c5a-f7a048b2492d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:58.006388 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:58.016492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:58.018032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:58.019184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a439663d-dc20-42fb-8e2c-ca1d4400fb1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1405 microversion: 2.20 time: 0.181237 Aug 01 15:28:58.019918 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 338/665] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:57 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:28:58.433476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7490f14e-9980-468c-8c5a-f7a048b2492d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "POST /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546391 Aug 01 15:28:58.434140 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 328/666] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:28:57 2022] POST /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:58.809742 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-4f0798a4-67ad-419c-83bd-899d50e5a3fe req-52fe5617-c8bb-423b-8775-c4f9d937a93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c295d39-1434-4597-a68a-a46cea5899f9", "name": "network-vif-plugged", "status": "completed", "tag": "e0b42de4-84fd-4819-a551-2256b22587ca"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:28:58.822095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4f0798a4-67ad-419c-83bd-899d50e5a3fe req-52fe5617-c8bb-423b-8775-c4f9d937a93f service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:58.822419 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-4f0798a4-67ad-419c-83bd-899d50e5a3fe req-52fe5617-c8bb-423b-8775-c4f9d937a93f service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:58.834261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:58.834859 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:58.835030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-4f0798a4-67ad-419c-83bd-899d50e5a3fe req-52fe5617-c8bb-423b-8775-c4f9d937a93f service nova] Creating event network-vif-plugged:e0b42de4-84fd-4819-a551-2256b22587ca for instance 1c295d39-1434-4597-a68a-a46cea5899f9 on hv-cinder-84713 Aug 01 15:28:58.839908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-4f0798a4-67ad-419c-83bd-899d50e5a3fe req-52fe5617-c8bb-423b-8775-c4f9d937a93f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034344 Aug 01 15:28:58.840885 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 339/667] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:28:58.842139 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:58.842665 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:58.843444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:58.843879 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:58.995595 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:59.003210 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2f878958-e2b8-4a73-bf48-6a67ba7adc20 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.174257 Aug 01 15:28:59.003776 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 329/668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:28:58 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:28:59.113570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:28:59.114290 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:28:59.120977 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:59.121427 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:59.122233 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:28:59.122663 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:28:59.261964 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:59.270179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:59.271719 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:28:59.272813 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2bd2af7c-e19d-4ec6-ab1e-e020387f5506 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1405 microversion: 2.20 time: 0.229101 Aug 01 15:28:59.273600 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 340/669] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:28:59 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:29:00.027274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:00.027971 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:00.030500 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=12 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:00.031216 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:00.037811 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:00.038453 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:00.039234 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:00.039667 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:00.196223 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:00.208308 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a53ea71-bab0-4d6e-89c4-4c54dddc81e0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.186302 Aug 01 15:29:00.209008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 330/670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:00 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:00.296337 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:00.297253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:00.306352 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:00.306795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:00.307586 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:00.308007 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:00.472550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:00.482110 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:00.483660 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:00.485310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-604e9be6-8bd0-4cad-983b-9eca1bb26d3a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1405 microversion: 2.20 time: 0.192758 Aug 01 15:29:00.486082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 341/671] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:29:00 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:29:01.234801 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:01.235699 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:01.242572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:01.243051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:01.243843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:01.244267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:01.395399 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:01.403773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17cc6e3e-f860-445f-b0d5-39333621aeb7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.172976 Aug 01 15:29:01.404485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 331/672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:01 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:01.512568 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:01.513199 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:01.515502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:01.516301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=16 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:01.524208 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:01.524661 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:01.526874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:01.526874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:01.667058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:01.681908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:01.684750 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:01.687066 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5c52cd98-3d70-4cdb-ae4e-21d2e678d7b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1598 microversion: 2.20 time: 0.178227 Aug 01 15:29:01.688051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 342/673] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:29:01 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:29:01.710607 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3352e1bf-7252-47fc-a835-f359705bc91f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:01.711012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3352e1bf-7252-47fc-a835-f359705bc91f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:01.717991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3352e1bf-7252-47fc-a835-f359705bc91f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:01.718441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3352e1bf-7252-47fc-a835-f359705bc91f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:01.719197 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3352e1bf-7252-47fc-a835-f359705bc91f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:01.719626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3352e1bf-7252-47fc-a835-f359705bc91f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:01.800917 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3352e1bf-7252-47fc-a835-f359705bc91f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095105 Aug 01 15:29:01.801539 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 332/674] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 1 15:29:01 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:29:02.426763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:02.427474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:02.434130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:02.434681 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:02.435453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:02.435952 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:02.593146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:02.601121 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9979d16f-64aa-4c91-a9f1-ca016a21079e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.178316 Aug 01 15:29:02.601935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 343/675] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:02 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:02.764640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-1c9c180e-bf40-4503-8770-294dcbede936 req-0945454d-8ed7-44e5-96e7-4509315215e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c295d39-1434-4597-a68a-a46cea5899f9", "tag": "e0b42de4-84fd-4819-a551-2256b22587ca"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:02.776417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1c9c180e-bf40-4503-8770-294dcbede936 req-0945454d-8ed7-44e5-96e7-4509315215e4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:02.776857 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1c9c180e-bf40-4503-8770-294dcbede936 req-0945454d-8ed7-44e5-96e7-4509315215e4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:02.791374 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-1c9c180e-bf40-4503-8770-294dcbede936 req-0945454d-8ed7-44e5-96e7-4509315215e4 service nova] Creating event network-changed:e0b42de4-84fd-4819-a551-2256b22587ca for instance 1c295d39-1434-4597-a68a-a46cea5899f9 on hv-cinder-84713 Aug 01 15:29:02.800284 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-1c9c180e-bf40-4503-8770-294dcbede936 req-0945454d-8ed7-44e5-96e7-4509315215e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039784 Aug 01 15:29:02.800979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 333/676] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:03.018912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-088d9ea5-6fab-4cbc-99b2-34914b0f4a66 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:03.021392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-088d9ea5-6fab-4cbc-99b2-34914b0f4a66 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:03.029222 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-088d9ea5-6fab-4cbc-99b2-34914b0f4a66 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.029994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-088d9ea5-6fab-4cbc-99b2-34914b0f4a66 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.030770 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-088d9ea5-6fab-4cbc-99b2-34914b0f4a66 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.031349 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-088d9ea5-6fab-4cbc-99b2-34914b0f4a66 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.071120 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-088d9ea5-6fab-4cbc-99b2-34914b0f4a66 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056326 Aug 01 15:29:03.073833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 344/677] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:29:03 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:29:03.147969 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:03.148686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:03.155604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.156199 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.157184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.157749 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.187165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:29:03.205750 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:03.297466 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b986c401-af2d-4bec-a61b-3254981a9655 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 204 len: 0 microversion: 2.1 time: 0.154564 Aug 01 15:29:03.298489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 334/678] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:29:03 2022] DELETE /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:29:03.307990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:03.309081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:03.316017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.316852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.317904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.318246 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.323205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:03.542731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:03.554688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b983a156-2abe-43a5-bae3-9916d84ec045 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1676 microversion: 2.1 time: 0.250961 Aug 01 15:29:03.562065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 345/679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:03 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1676 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:03.626711 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:03.627692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:03.637358 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.637831 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.638614 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:03.639147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:03.800485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:03.810842 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b9303825-d7eb-4890-9942-939b2b6c3e9d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.190942 Aug 01 15:29:03.811427 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 335/680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:03 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:04.579069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:04.579706 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:04.587024 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:04.587481 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:04.588245 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:04.588686 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:04.722244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:04.736969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a900a6a-8f0e-4a76-912d-ee0a9577c047 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1676 microversion: 2.1 time: 0.161642 Aug 01 15:29:04.737739 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 346/681] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:04 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:04.831537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:04.832065 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:04.839654 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:04.840104 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:04.840870 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:04.841302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:04.993586 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:05.001934 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc9e6492-fc28-427f-b513-ed7e32510e2a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.174449 Aug 01 15:29:05.002539 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 336/682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:04 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:05.882929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:05.883535 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:05.891125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:05.891557 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:05.892337 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:05.892758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:06.023766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:06.024518 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:06.031222 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:06.031662 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:06.032563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:06.032992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:06.041549 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:06.049236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-81463913-f429-4d8d-b681-2fa5d168fbe8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1676 microversion: 2.1 time: 0.286621 Aug 01 15:29:06.049856 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 347/683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:05 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1676 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:06.175711 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:06.183948 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e1a209f4-40c6-4c21-b245-a6b8330d3232 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.164660 Aug 01 15:29:06.184527 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 337/684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:06 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:29:07.071392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:07.072107 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:07.079174 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:07.079619 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:07.080380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:07.080809 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:07.206650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:07.207572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:07.213927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:07.214475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:07.215313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:07.215790 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:07.232057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:07.240178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0f07f27-9efb-4998-b808-637d01ae9964 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1676 microversion: 2.1 time: 0.173222 Aug 01 15:29:07.240752 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 348/685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:07 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:07.356340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:07.365063 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c6c46e2d-dcb1-4de7-9683-70cce1890b89 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.162976 Aug 01 15:29:07.365659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 338/686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:07 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:29:08.265031 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:08.266414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:08.273619 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:08.274627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:08.275744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:08.276410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:08.388557 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:08.398676 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:08.403102 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:08.408376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d24b09a-0488-417a-88d2-2b3c8465c7e6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1608 microversion: 2.1 time: 0.148566 Aug 01 15:29:08.409851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 349/687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:08 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1608 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:29:08.428342 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:08.429067 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:08.430326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:08.430766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:08.655077 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:08.664389 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eb76cd5f-2510-4335-9da0-7675dd0a7794 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.269940 Aug 01 15:29:08.664389 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 339/688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:08 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:08.780992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-d271b3a1-d29b-45ab-93cc-97fbbc89f4c2 req-6028868c-fc6c-4811-9cab-360e937cac2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762918ff-4812-4e05-be65-d3ab81a9ec32", "name": "network-vif-deleted", "tag": "60a932ce-6123-415c-afb5-2c7b47a4a2e7"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:08.791945 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d271b3a1-d29b-45ab-93cc-97fbbc89f4c2 req-6028868c-fc6c-4811-9cab-360e937cac2b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:08.792380 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d271b3a1-d29b-45ab-93cc-97fbbc89f4c2 req-6028868c-fc6c-4811-9cab-360e937cac2b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:08.805226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-d271b3a1-d29b-45ab-93cc-97fbbc89f4c2 req-6028868c-fc6c-4811-9cab-360e937cac2b service nova] Creating event network-vif-deleted:60a932ce-6123-415c-afb5-2c7b47a4a2e7 for instance 762918ff-4812-4e05-be65-d3ab81a9ec32 on hv-cinder-84713 Aug 01 15:29:08.811439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-d271b3a1-d29b-45ab-93cc-97fbbc89f4c2 req-6028868c-fc6c-4811-9cab-360e937cac2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Aug 01 15:29:08.812051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 350/689] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:09.431115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:09.431736 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:09.438643 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:09.439092 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:09.439859 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:09.440294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:09.505856 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:09.514232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-81dbd5e2-2d30-4e58-9470-478653570b46 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1608 microversion: 2.1 time: 0.087034 Aug 01 15:29:09.514918 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 340/690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:09 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1608 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:09.690625 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:09.691328 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:09.698324 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:09.698758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:09.699555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:09.699991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:09.843514 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:09.852703 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f94a0573-3116-44da-970c-e6c12b2ad57e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.171450 Aug 01 15:29:09.869618 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 351/691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:09 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:09.890861 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:09.891348 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:09.897361 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:09.897833 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:09.898797 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:09.899240 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:09.988953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lazy-loading 'services' on Instance uuid 07157dfb-c02b-4928-9053-f93eed2ef8ef {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:29:10.070055 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-17affa3b-5358-4fc6-89f1-9698f964197a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "DELETE /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments/4d964f65-7ec9-4505-84f4-050d85333a0a" status: 202 len: 0 microversion: 2.1 time: 0.183105 Aug 01 15:29:10.070627 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 341/692] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:29:09 2022] DELETE /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments/4d964f65-7ec9-4505-84f4-050d85333a0a => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:29:10.080179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-030405b9-7d2a-4529-bba9-e025ea744556 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:10.082877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-030405b9-7d2a-4529-bba9-e025ea744556 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:10.089297 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-030405b9-7d2a-4529-bba9-e025ea744556 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:10.089739 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-030405b9-7d2a-4529-bba9-e025ea744556 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:10.090536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-030405b9-7d2a-4529-bba9-e025ea744556 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:10.090963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-030405b9-7d2a-4529-bba9-e025ea744556 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:10.124258 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-030405b9-7d2a-4529-bba9-e025ea744556 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048818 Aug 01 15:29:10.124894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 352/693] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:29:10 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:10.537761 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:10.538970 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:10.545709 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:10.546202 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:10.547002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:10.547433 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:10.596433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-72538e2d-dcfc-4c3e-ba1e-8e7c4a100556 req-da701a31-401d-4709-9279-9f00e34bdff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b501c28-26be-4cb3-a318-b04537a639b6", "name": "network-vif-plugged", "status": "completed", "tag": "843a5381-9438-4fea-9e56-3350e9f962c1"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:10.606731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-72538e2d-dcfc-4c3e-ba1e-8e7c4a100556 req-da701a31-401d-4709-9279-9f00e34bdff4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:10.607070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-72538e2d-dcfc-4c3e-ba1e-8e7c4a100556 req-da701a31-401d-4709-9279-9f00e34bdff4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:10.615342 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:10.619798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-72538e2d-dcfc-4c3e-ba1e-8e7c4a100556 req-da701a31-401d-4709-9279-9f00e34bdff4 service nova] Creating event network-vif-plugged:843a5381-9438-4fea-9e56-3350e9f962c1 for instance 8b501c28-26be-4cb3-a318-b04537a639b6 on hv-cinder-84713 Aug 01 15:29:10.623702 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-406bc040-5f32-4dae-b44f-bcf81515841b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1323 microversion: 2.1 time: 0.090624 Aug 01 15:29:10.624223 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 342/694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:10 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:10.624608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-72538e2d-dcfc-4c3e-ba1e-8e7c4a100556 req-da701a31-401d-4709-9279-9f00e34bdff4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Aug 01 15:29:10.625160 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 353/695] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:29:10.875905 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:10.876410 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:10.883940 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:10.884391 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:10.886131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:10.886131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:11.037111 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:11.047205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c03e60d4-d052-4db2-b407-c83f7073596b tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.177502 Aug 01 15:29:11.047769 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 343/696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:10 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:11.144504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-44dbc12b-68b9-4611-8152-9d253aed8ed8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:11.148267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-44dbc12b-68b9-4611-8152-9d253aed8ed8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:11.155378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbc12b-68b9-4611-8152-9d253aed8ed8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:11.155822 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbc12b-68b9-4611-8152-9d253aed8ed8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:11.156630 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbc12b-68b9-4611-8152-9d253aed8ed8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:11.157071 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbc12b-68b9-4611-8152-9d253aed8ed8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:11.202392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-44dbc12b-68b9-4611-8152-9d253aed8ed8 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066028 Aug 01 15:29:11.202953 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 354/697] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:29:11 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:11.645469 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:11.646391 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:11.652948 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:11.653391 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:11.654210 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:11.654733 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:11.685717 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:11.686095 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:11.686568 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lazy-loading 'fault' on Instance uuid 762918ff-4812-4e05-be65-d3ab81a9ec32 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:29:11.736115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:11.749405 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3cd098f0-be66-4296-8ef1-120a9ad11cab tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 200 len: 1328 microversion: 2.1 time: 0.107979 Aug 01 15:29:11.749996 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 344/698] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:11 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:12.068595 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:12.069342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:12.077180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:12.077627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:12.078417 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:12.078847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:12.215376 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e5c9468d-cffb-45d2-ad78-08346fbcef33 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:12.217747 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e5c9468d-cffb-45d2-ad78-08346fbcef33 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:12.224215 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5c9468d-cffb-45d2-ad78-08346fbcef33 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:12.224663 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5c9468d-cffb-45d2-ad78-08346fbcef33 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:12.225422 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5c9468d-cffb-45d2-ad78-08346fbcef33 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:12.225889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e5c9468d-cffb-45d2-ad78-08346fbcef33 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:12.234274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:12.242150 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ff7e6ef-3c4d-426d-8d6e-c84b4fc15f88 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.178166 Aug 01 15:29:12.242797 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 355/699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:12 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:12.256309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e5c9468d-cffb-45d2-ad78-08346fbcef33 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Aug 01 15:29:12.257088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 345/700] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:29:12 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:12.770382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:12.770985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:12.777744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:12.778217 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:12.778989 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:12.779421 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:12.794125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] HTTP exception thrown: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Request method failure captured: Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 HTTP/1.1 Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AWP30hUQfhi2C8UkMpSx3bh0fLBSt0O2p0psKO_yKogOEjhYRK_f5htYXhJ3XovQTE1U1KdFkiImC9TSL3zIAjeF6d64CNQqmmTi3LODFrFP0Nd3TPFSPu7anJbUsxiAXRi42eAZr33ma94u39p6P2GoCnFUu3_9O0q7_wY9hJJyQ Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:29:12.795892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}] Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 93d86ae4501e43d59d172d2e7acfdd54 Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:29:12.797476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '762918ff-4812-4e05-be65-d3ab81a9ec32'} Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:12.801866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:29:12.803203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:12.804504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Returning 404 to user: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:12.804504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6e1afd87-f7d6-484d-b4bd-4d8d0723e565 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 404 len: 111 microversion: 2.1 time: 0.030988 Aug 01 15:29:12.804504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 356/701] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:12 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:29:12.809761 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a8ad4d1-180e-4be6-b934-d585ec0e5268 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '.version_select at 0x7f036735a790>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:12.829228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a8ad4d1-180e-4be6-b934-d585ec0e5268 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038889112" status: 202 len: 0 microversion: 2.1 time: 0.023255 Aug 01 15:29:12.829818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 346/702] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 15:29:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038889112 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:29:13.263803 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:13.264561 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:13.268939 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5dac5218-be44-400a-b72b-1451e8e636fe tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:13.271202 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5dac5218-be44-400a-b72b-1451e8e636fe tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:13.271636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.272084 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.272847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.273458 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.280283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dac5218-be44-400a-b72b-1451e8e636fe tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.281262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dac5218-be44-400a-b72b-1451e8e636fe tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.281730 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dac5218-be44-400a-b72b-1451e8e636fe tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.282272 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5dac5218-be44-400a-b72b-1451e8e636fe tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.313033 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5dac5218-be44-400a-b72b-1451e8e636fe tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048338 Aug 01 15:29:13.313722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 347/703] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:29:13 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 15:29:13.397948 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:13.398345 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:13.404556 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.405005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.405813 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.406260 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.433504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:29:13.480302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:13.490192 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:13.502251 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2b711105-a692-4c0a-8594-2498e17be01c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.242560 Aug 01 15:29:13.503341 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 357/704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:13 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:13.526723 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1f38e69d-3678-4142-a5fe-cfff02b3cd09 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "DELETE /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 204 len: 0 microversion: 2.1 time: 0.132557 Aug 01 15:29:13.527323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 348/705] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:29:13 2022] DELETE /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:29:13.536292 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:13.536761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:13.544360 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.545176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.546781 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:13.547386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:13.559656 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-abe579b4-b5bc-462a-bca7-f45516aa0ea4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'create', calling method: .version_select at 0x7f03672f6f70>, body: {"keypair": {"name": "tempest-keypair-595044583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7VJubgkWwX2CUTG0unRwVFYrhHza6fudVqVAycVboaVL2uQH/kzpmBtAGlOMyOhkRcas3mfC0/5567cPJW0duoWNVG/UMpwSjkaXvzEMtmCVeQ87JWqqsSF5c9XBI6qA=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:13.575001 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-abe579b4-b5bc-462a-bca7-f45516aa0ea4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:29:13.578842 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-abe579b4-b5bc-462a-bca7-f45516aa0ea4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for user 93d86ae4501e43d59d172d2e7acfdd54 and project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:29:13.603140 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-abe579b4-b5bc-462a-bca7-f45516aa0ea4 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051864 Aug 01 15:29:13.603739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 349/706] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:29:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:13.688995 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:13.697030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ee7386b0-a548-4bda-9d17-a2bbf3c053b4 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1687 microversion: 2.1 time: 0.165025 Aug 01 15:29:13.697604 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 358/707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:13 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:14.529624 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:14.530425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:14.538218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:14.538667 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:14.539443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:14.539872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:14.677237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:14.684889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-69fa14cc-16f2-4312-9d6f-6b927a221c8d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.160792 Aug 01 15:29:14.685552 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 350/708] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:14 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:14.718608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:14.719210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:14.725969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:14.726625 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:14.727215 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:14.727642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:14.864059 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:14.872048 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27a04f53-5a5e-42fc-ab42-9d74f8647354 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1687 microversion: 2.1 time: 0.157265 Aug 01 15:29:14.873833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 359/709] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:14 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:14.897759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1316996699", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dca719a4-8083-4887-9cb5-1436224f08c6"}], "security_groups": [{"name": "tempest-securitygroup--119389588"}], "key_name": "tempest-keypair-595044583", "user_data": "}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:15.004336 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] validate_networks() for [('dca719a4-8083-4887-9cb5-1436224f08c6', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:29:15.706464 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:15.707497 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:15.714682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:15.715106 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:15.715885 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:15.716319 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:15.732877 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:29:15.733987 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:29:15.734451 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:29:15.734852 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:29:15.735941 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:29:15.744699 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:15.745166 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:15.745953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:15.746606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:15.763778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:29:15.767975 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Getting quotas for user 93d86ae4501e43d59d172d2e7acfdd54 and project 3b8e7cb5fc4a4e598d27e51122265bda. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:29:15.778843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:29:15.781205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:29:15.827985 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-73b3fd1c-79b8-4085-9b8c-52a421a2cfe6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.934480 Aug 01 15:29:15.828788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 351/710] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:29:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:29:15.840323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-00ca82d1-89b8-419a-874a-e2fce9d3ad8b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:15.840949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-00ca82d1-89b8-419a-874a-e2fce9d3ad8b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:15.869294 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:15.882226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-238ad1d4-8460-4bf7-8c2c-b18455a41877 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.179589 Aug 01 15:29:15.882794 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 360/711] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:15 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:15.897729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:15.898361 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:15.906677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:15.907128 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:15.908122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:15.908566 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:15.916736 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-00ca82d1-89b8-419a-874a-e2fce9d3ad8b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:15.924652 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-00ca82d1-89b8-419a-874a-e2fce9d3ad8b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1237 microversion: 2.1 time: 0.088264 Aug 01 15:29:15.925262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 352/712] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:15 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:16.067111 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:16.076814 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-190dbe8b-b7ac-4fe7-8051-01f814e3563e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1687 microversion: 2.1 time: 0.187619 Aug 01 15:29:16.077601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 361/713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:15 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:16.903856 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:16.904456 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:16.911258 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:16.911691 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:16.912435 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:16.912860 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:16.944546 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:16.945173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:16.951982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:16.952435 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:16.953206 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:16.953740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:17.031080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:17.039376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e3ada004-8cec-4f0b-a36c-9b2b399b4d75 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1241 microversion: 2.1 time: 0.098388 Aug 01 15:29:17.039936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 362/714] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:16 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:17.083781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:17.091632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ed2c7cd7-76f9-4595-842a-db72a0135c12 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.191746 Aug 01 15:29:17.092200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 353/715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:16 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:17.099614 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:17.100226 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:17.107410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:17.107852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:17.108614 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:17.109043 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:17.241191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:17.246857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:17.254676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff37c56d-a14b-42f2-a0b9-825520865725 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1687 microversion: 2.1 time: 0.158696 Aug 01 15:29:17.255568 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 363/716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:17 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:18.060389 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:18.061000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:18.067710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:18.068188 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:18.068944 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:18.069382 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:18.112917 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:18.113537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:18.120888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:18.121382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:18.122142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:18.122576 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:18.136110 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:18.144367 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6449a6d1-42a2-419c-bda3-f52b31d7416b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1241 microversion: 2.1 time: 0.087859 Aug 01 15:29:18.145181 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 354/717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:18 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:18.268466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:18.276311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-08286ce6-39b1-4850-8988-3a2168f79dca tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.167390 Aug 01 15:29:18.276855 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 364/718] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:18 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:18.279787 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:18.280389 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:18.286741 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:18.287186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:18.287944 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:18.288350 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:18.424866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:18.431461 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eff405b2-1b3f-4fb5-974e-5deea112c54f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1687 microversion: 2.1 time: 0.155357 Aug 01 15:29:18.432338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 355/719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:18 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:19.166324 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:19.166910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:19.174224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:19.174683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:19.175434 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:19.175948 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:19.251830 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:19.263443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5304eb79-e260-4545-bbc9-e5835a8005fe tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1241 microversion: 2.1 time: 0.100734 Aug 01 15:29:19.264016 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 365/720] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:19 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:19.297568 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:19.298242 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:19.306627 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:19.307080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:19.307905 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:19.308282 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:19.452375 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:19.460939 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:19.461147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f2eadb0b-96f6-4c1f-b3ac-b3c91c2019c4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.167852 Aug 01 15:29:19.461498 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 356/721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:19 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:19.461677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:19.467980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:19.468423 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:19.469227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:19.469683 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:19.623916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:19.632239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f79e834b-4b7d-41c0-ba41-7d36d467919d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1687 microversion: 2.1 time: 0.175557 Aug 01 15:29:19.632817 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 366/722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:19 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:29:20.133953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:20.134370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:20.140463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.140900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.141790 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.142165 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.284943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:20.285638 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:20.292777 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.293310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.294112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.294536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.360955 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:20.368883 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-727d1e15-9889-4033-99e1-e8b20fcec061 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1289 microversion: 2.1 time: 0.088061 Aug 01 15:29:20.369749 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 367/723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:20 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:20.378563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lazy-loading 'services' on Instance uuid 936bab3c-e55e-452b-ab78-367e9b0669cd {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:29:20.455213 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a757342-a804-4100-bd42-1faf08657fad tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd/os-volume_attachments/d95d43e4-3df5-4f5e-9ea6-c0cffc47a24d" status: 202 len: 0 microversion: 2.1 time: 0.324961 Aug 01 15:29:20.455806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 357/724] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:29:20 2022] DELETE /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd/os-volume_attachments/d95d43e4-3df5-4f5e-9ea6-c0cffc47a24d => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:29:20.481364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:20.482026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:20.488412 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.488974 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.489742 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.490200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.634973 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:20.646058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9cc4b438-933e-4297-bc49-e92da74a6718 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1267 microversion: 2.1 time: 0.168356 Aug 01 15:29:20.646873 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 368/725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:20 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:20.653570 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:20.654187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:20.656350 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:20.661969 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.662404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.663172 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:20.663598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:20.912483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:20.921732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-78cbbffe-7b80-49f4-9f0f-1fbdae017008 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1687 microversion: 2.1 time: 0.272351 Aug 01 15:29:20.935256 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 358/726] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:20 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1687 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:21.391340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:21.392562 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:21.395052 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:21.402856 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:21.404552 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:21.405823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:21.406424 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:21.497467 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:21.506241 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-507f822f-58c3-4b60-8079-b270179df2c5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1297 microversion: 2.1 time: 0.118895 Aug 01 15:29:21.506823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 369/727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:21 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:21.669114 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:21.670317 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:21.678336 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:21.678933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:21.679854 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:21.680384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:21.877843 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-fd929ce5-12a4-4218-a6ed-4ffbe997d8dc req-d0999ea6-8921-4b4e-ba30-c12860660214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07157dfb-c02b-4928-9053-f93eed2ef8ef", "name": "network-vif-deleted", "tag": "b896bca9-acf1-4e03-aed9-a817f5160dab"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:21.895146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fd929ce5-12a4-4218-a6ed-4ffbe997d8dc req-d0999ea6-8921-4b4e-ba30-c12860660214 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:21.895812 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fd929ce5-12a4-4218-a6ed-4ffbe997d8dc req-d0999ea6-8921-4b4e-ba30-c12860660214 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:21.907518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-fd929ce5-12a4-4218-a6ed-4ffbe997d8dc req-d0999ea6-8921-4b4e-ba30-c12860660214 service nova] Creating event network-vif-deleted:b896bca9-acf1-4e03-aed9-a817f5160dab for instance 07157dfb-c02b-4928-9053-f93eed2ef8ef on hv-cinder-84713 Aug 01 15:29:21.914500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-fd929ce5-12a4-4218-a6ed-4ffbe997d8dc req-d0999ea6-8921-4b4e-ba30-c12860660214 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040879 Aug 01 15:29:21.915772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 370/728] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:29:21.943913 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:21.944951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:21.953631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:21.954399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:21.955414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:21.955988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:21.989270 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:21.998927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f81f77d6-cc66-463c-8323-af8c8a292330 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1453 microversion: 2.1 time: 0.334160 Aug 01 15:29:21.999669 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 359/729] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:21 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1453 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:22.022278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:22.023141 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:22.030338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.034605 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:22.034761 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.035444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.035893 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.042754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a049251f-e868-4222-abf1-4cb141b48c9e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 200 len: 1330 microversion: 2.1 time: 0.103105 Aug 01 15:29:22.059028 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 371/730] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:21 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 1330 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:22.276204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:22.283302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-764b432b-f71e-47ad-86eb-a681955187a4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1453 microversion: 2.1 time: 0.264823 Aug 01 15:29:22.284348 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 360/731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:22 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1453 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:29:22.529002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:22.531149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:22.542522 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.542974 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.547665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.555460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.725606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:22.726141 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:22.736178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.736777 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.737619 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.738304 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.783690 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:29:22.895302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-141c784c-6c01-4d5c-90f6-43fb729acfd8 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 204 len: 0 microversion: 2.1 time: 0.174248 Aug 01 15:29:22.896206 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 361/732] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:29:22 2022] DELETE /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:29:22.909192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:22.911463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:22.920117 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.921168 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.922237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:22.922913 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:22.980823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:22.992246 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ccc3b198-d0ef-409a-8065-d5cc2949522e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.468445 Aug 01 15:29:22.993746 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 372/733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:22 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:23.073318 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:23.075734 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 07157dfb-c02b-4928-9053-f93eed2ef8ef] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:23.101631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:23.118384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:23.121514 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:23.122067 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:23.141351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] HTTP exception thrown: Instance 07157dfb-c02b-4928-9053-f93eed2ef8ef could not be found. Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Request method failure captured: Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef HTTP/1.1 Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AOu_gdPJh0fnK6IS6_RTfqlgP9yrCVUGQhjW_TZeS1pFWe7vx8I5l9_sgQyQZoDiqSD5GtGFTLQuG5OUSscK7EY_2AKImIIGZJWxUiBnAzw94Vx0O3XIMK_l0OwZ2sdoCKY_nEhejN9WsqralWbhs4hTuS-P0k6e3k4fdszvGJ9K4 Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:29:23.143340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}] Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 6f852249c66a4f8986d7a63a957ec91c Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 07157dfb-c02b-4928-9053-f93eed2ef8ef could not be found. Aug 01 15:29:23.145027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '07157dfb-c02b-4928-9053-f93eed2ef8ef'} Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07157dfb-c02b-4928-9053-f93eed2ef8ef could not be found. Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:23.145988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07157dfb-c02b-4928-9053-f93eed2ef8ef could not be found. Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07157dfb-c02b-4928-9053-f93eed2ef8ef could not be found. Aug 01 15:29:23.147250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:23.149155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Returning 404 to user: Instance 07157dfb-c02b-4928-9053-f93eed2ef8ef could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:23.149155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad4bc760-dfb4-4f3a-a765-c93e3cd35f00 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef" status: 404 len: 111 microversion: 2.1 time: 0.084372 Aug 01 15:29:23.149155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 373/734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:23 2022] GET /compute/v2.1/servers/07157dfb-c02b-4928-9053-f93eed2ef8ef => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:29:23.157247 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-05ec30aa-b850-4ea2-9dab-00896349d5ce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '.version_select at 0x7f03674cd0d0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:23.182789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-05ec30aa-b850-4ea2-9dab-00896349d5ce tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562267991" status: 202 len: 0 microversion: 2.1 time: 0.029318 Aug 01 15:29:23.184076 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 374/735] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 15:29:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562267991 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:29:23.304973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:23.316360 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f3e4a992-c374-4eba-bf3a-d54393b0611f tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1513 microversion: 2.1 time: 0.411607 Aug 01 15:29:23.317089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 362/736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:22 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:23.934773 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-61e7122c-dd84-4687-bdff-59997d08e6ed req-f01d8fb2-84b5-4ec8-8d2e-958b4b042056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a569a7b-878e-482c-81f8-da11268e6b1b", "tag": "699467db-9a6e-4148-9a8e-aec74ec3b36f"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:23.946277 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-61e7122c-dd84-4687-bdff-59997d08e6ed req-f01d8fb2-84b5-4ec8-8d2e-958b4b042056 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:23.947000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-61e7122c-dd84-4687-bdff-59997d08e6ed req-f01d8fb2-84b5-4ec8-8d2e-958b4b042056 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:23.958367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-61e7122c-dd84-4687-bdff-59997d08e6ed req-f01d8fb2-84b5-4ec8-8d2e-958b4b042056 service nova] Creating event network-changed:699467db-9a6e-4148-9a8e-aec74ec3b36f for instance 0a569a7b-878e-482c-81f8-da11268e6b1b on hv-cinder-84713 Aug 01 15:29:23.963634 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-61e7122c-dd84-4687-bdff-59997d08e6ed req-f01d8fb2-84b5-4ec8-8d2e-958b4b042056 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033472 Aug 01 15:29:23.964522 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 375/737] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:24.017927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:24.018544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:24.026440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:24.026999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:24.027866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:24.028561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:24.339753 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:24.340770 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:24.350193 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:24.351633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:24.352677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:24.353455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:24.423498 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:24.434849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5f871fad-ce47-4456-a708-7d4567be77ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.420782 Aug 01 15:29:24.436276 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 363/738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:24 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:24.561316 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:24.570289 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e72fd720-94b3-4051-8f91-aca17b071e3d tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1513 microversion: 2.1 time: 0.235657 Aug 01 15:29:24.570866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 376/739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:24 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:24.601697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-c7b2e8d3-1177-4d3f-9ff4-9492b4a789f2 req-f666b0b7-e895-4801-8756-09e274fd94c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b501c28-26be-4cb3-a318-b04537a639b6", "tag": "843a5381-9438-4fea-9e56-3350e9f962c1"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:24.611308 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-c7b2e8d3-1177-4d3f-9ff4-9492b4a789f2 req-f666b0b7-e895-4801-8756-09e274fd94c7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:24.611744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-c7b2e8d3-1177-4d3f-9ff4-9492b4a789f2 req-f666b0b7-e895-4801-8756-09e274fd94c7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:24.622657 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-c7b2e8d3-1177-4d3f-9ff4-9492b4a789f2 req-f666b0b7-e895-4801-8756-09e274fd94c7 service nova] Creating event network-changed:843a5381-9438-4fea-9e56-3350e9f962c1 for instance 8b501c28-26be-4cb3-a318-b04537a639b6 on hv-cinder-84713 Aug 01 15:29:24.627535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-c7b2e8d3-1177-4d3f-9ff4-9492b4a789f2 req-f666b0b7-e895-4801-8756-09e274fd94c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029567 Aug 01 15:29:24.628154 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 364/740] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:25.457169 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:25.458016 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:25.466171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:25.466791 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:25.467732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:25.468505 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:25.602190 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:25.603922 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:25.616582 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:25.617228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:25.618846 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:25.619439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:25.659873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:25.661138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:25.662425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lazy-loading 'fault' on Instance uuid 936bab3c-e55e-452b-ab78-367e9b0669cd {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:29:25.713061 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:25.721081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-010986a6-2937-4711-ba35-ce70de761f30 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.268885 Aug 01 15:29:25.721715 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 377/741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:25 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:25.730850 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1afe2bda6784f9987b8aa5fa174dde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc512d8e2ab848fda424f9eeb6c816c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:25.733178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:25.739961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-751bd118-95ac-4186-baa1-2b9cc2ad2fea tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 200 len: 1309 microversion: 2.1 time: 0.151297 Aug 01 15:29:25.740753 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 365/742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:25 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:29:26.721354 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-0d7860bd-1b64-44f6-8ad1-31659c568449 req-b127934c-df69-4909-a78e-fd53cf3b7404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936bab3c-e55e-452b-ab78-367e9b0669cd", "name": "network-vif-deleted", "tag": "c3beecfd-7a2f-4a20-abf7-0ca5a0a67d3a"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:26.726616 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:26.727112 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:26.729232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:26.729962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=12 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:26.731551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0d7860bd-1b64-44f6-8ad1-31659c568449 req-b127934c-df69-4909-a78e-fd53cf3b7404 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.732028 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0d7860bd-1b64-44f6-8ad1-31659c568449 req-b127934c-df69-4909-a78e-fd53cf3b7404 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.737104 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.737560 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.739993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.739993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.743601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-0d7860bd-1b64-44f6-8ad1-31659c568449 req-b127934c-df69-4909-a78e-fd53cf3b7404 service nova] Creating event network-vif-deleted:c3beecfd-7a2f-4a20-abf7-0ca5a0a67d3a for instance 936bab3c-e55e-452b-ab78-367e9b0669cd on hv-cinder-84713 Aug 01 15:29:26.748555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-0d7860bd-1b64-44f6-8ad1-31659c568449 req-b127934c-df69-4909-a78e-fd53cf3b7404 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106229 Aug 01 15:29:26.752452 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 378/743] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:26.754359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:26.755052 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:26.761392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.761867 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.762636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.763093 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.766770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:29:26.851977 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-eb2a7006-432b-40c8-a407-bccd146f337f tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "DELETE /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 204 len: 0 microversion: 2.1 time: 0.128834 Aug 01 15:29:26.853035 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 366/744] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:29:26 2022] DELETE /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:29:26.859995 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:26.860691 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] [instance: 936bab3c-e55e-452b-ab78-367e9b0669cd] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:26.871574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.872012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.872777 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.873330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.890610 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] HTTP exception thrown: Instance 936bab3c-e55e-452b-ab78-367e9b0669cd could not be found. Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Request method failure captured: Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd HTTP/1.1 Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_DRb8mblEGOAJDlcvfAN86g33tSxxikNcSxQ_Exwm_8lVI2Z-_Cof-8gi43KheFGTeg931hgqUFcPip3j5cYlueKSy14ycKUpBxH6oPSiPkNFgYjlgK2E37V2TrDqhAR63OXM_UqHhEs4Qiq7e9VtSgyLlr2YvdCw3S9BCe92XnzSY Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: dc512d8e2ab848fda424f9eeb6c816c9 Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712758365 Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:29:26.892640 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc512d8e2ab848fda424f9eeb6c816c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc512d8e2ab848fda424f9eeb6c816c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc512d8e2ab848fda424f9eeb6c816c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc512d8e2ab848fda424f9eeb6c816c9"}]}] Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotTestJSON-712758365 Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: dc512d8e2ab848fda424f9eeb6c816c9 Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712758365 Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotTestJSON-712758365-project Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: b1afe2bda6784f9987b8aa5fa174dde2 Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotTestJSON-712758365-project Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 936bab3c-e55e-452b-ab78-367e9b0669cd could not be found. Aug 01 15:29:26.894425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '936bab3c-e55e-452b-ab78-367e9b0669cd'} Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936bab3c-e55e-452b-ab78-367e9b0669cd could not be found. Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:26.895294 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936bab3c-e55e-452b-ab78-367e9b0669cd could not be found. Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936bab3c-e55e-452b-ab78-367e9b0669cd could not be found. Aug 01 15:29:26.896495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:26.897519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] Returning 404 to user: Instance 936bab3c-e55e-452b-ab78-367e9b0669cd could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:26.897519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-69aedeb0-b60d-4153-a585-231912298941 tempest-VolumesSnapshotTestJSON-712758365 tempest-VolumesSnapshotTestJSON-712758365-project] 10.222.0.48 "GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd" status: 404 len: 111 microversion: 2.1 time: 0.039841 Aug 01 15:29:26.897519 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 367/745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:26 2022] GET /compute/v2.1/servers/936bab3c-e55e-452b-ab78-367e9b0669cd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:29:26.902106 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:26.902711 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:26.908988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.909508 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.910313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:26.910744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:26.910907 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:26.919815 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63fceb4c-4425-4de1-b56b-ec9315e3def8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.169531 Aug 01 15:29:26.920598 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 379/746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:26 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:27.048303 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:27.059265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-07d45e57-27e2-4d36-abde-247ceba1f4a3 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1506 microversion: 2.1 time: 0.163033 Aug 01 15:29:27.059871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 368/747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:26 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:27.141320 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-751ab860-4e13-463a-b020-69ee3e433546 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:27.142220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-751ab860-4e13-463a-b020-69ee3e433546 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:27.149264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-751ab860-4e13-463a-b020-69ee3e433546 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:27.149743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-751ab860-4e13-463a-b020-69ee3e433546 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:27.150757 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-751ab860-4e13-463a-b020-69ee3e433546 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:27.151191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-751ab860-4e13-463a-b020-69ee3e433546 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:27.177086 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-751ab860-4e13-463a-b020-69ee3e433546 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/ips" status: 200 len: 150 microversion: 2.1 time: 0.103634 Aug 01 15:29:27.177749 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 380/748] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:29:27 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:27.942416 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:27.942946 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:27.950746 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:27.951196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:27.951965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:27.952396 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:28.081123 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:28.082201 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:28.087938 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:28.089408 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:28.089887 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:28.090674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:28.091097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:28.095513 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0f7f7f34-0a1a-43a5-bf4f-e4b36588bcb3 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.157080 Aug 01 15:29:28.096136 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 369/749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:27 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:28.230922 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:28.239197 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8a6e6276-b519-4092-92c7-7dff89f6e91a tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1506 microversion: 2.1 time: 0.161922 Aug 01 15:29:28.240126 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 381/750] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:28 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:28.515292 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3c11584a-5a36-4d1b-9532-f9575adbb2dc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48cab6aa-faec-4c10-926a-9b3b9a5336fe"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:28.518992 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3c11584a-5a36-4d1b-9532-f9575adbb2dc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:28.525518 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c11584a-5a36-4d1b-9532-f9575adbb2dc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:28.525993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c11584a-5a36-4d1b-9532-f9575adbb2dc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:28.526751 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c11584a-5a36-4d1b-9532-f9575adbb2dc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:28.527164 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3c11584a-5a36-4d1b-9532-f9575adbb2dc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:29.121824 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:29.122845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:29.132067 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:29.132573 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:29.133329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:29.133755 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:29.282954 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:29.294950 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff67483c-0f6f-46b2-9ae0-9c210986d075 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.179553 Aug 01 15:29:29.295682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 382/751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:29 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:29.300195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:29.300791 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:29.306617 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:29.307068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:29.307833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:29.308267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:29.443080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:29.451530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-77fa6aa6-63a9-4af2-8233-8e9b97a52f02 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1506 microversion: 2.1 time: 0.154864 Aug 01 15:29:29.452099 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 383/752] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:29 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:30.320789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:30.321813 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:30.332825 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:30.333260 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:30.334057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:30.334590 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:30.352728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:30.471207 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:30.479476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e04afbf5-c8f7-456d-a4ad-39f567ba42c9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.165497 Aug 01 15:29:30.480049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 384/753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:30 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:30.484688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:30.485295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:30.493906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:30.493906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:30.493906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:30.493906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:30.633951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:30.641822 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2c1309ec-cda2-4487-b13a-b042d6bd6e42 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1506 microversion: 2.1 time: 0.160763 Aug 01 15:29:30.642388 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 385/754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:30 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:31.501499 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:31.502232 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:31.510321 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:31.510833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:31.513010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:31.513745 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:31.520596 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3c11584a-5a36-4d1b-9532-f9575adbb2dc tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.011127 Aug 01 15:29:31.527358 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 370/755] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:29:28 2022] POST /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments => generated 194 bytes in 3019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:31.664460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:31.665290 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:31.672462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:31.672742 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:31.673541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:31.674003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:31.675388 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:31.683270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8de8cf4-ab53-422c-9eff-052e1fc6127c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.186637 Aug 01 15:29:31.683914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 386/756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:31 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:31.815754 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:31.832768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-40686be5-524d-4f76-abc0-1350b18cf3cc tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1506 microversion: 2.1 time: 0.173183 Aug 01 15:29:31.833326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 371/757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:31 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:31.965756 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-579a9f39-d6c0-4e43-8809-f43c70ad69ee req-21006c89-5d59-4cc9-8c71-89a2de644ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a569a7b-878e-482c-81f8-da11268e6b1b", "name": "network-vif-plugged", "status": "completed", "tag": "699467db-9a6e-4148-9a8e-aec74ec3b36f"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:31.976771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-579a9f39-d6c0-4e43-8809-f43c70ad69ee req-21006c89-5d59-4cc9-8c71-89a2de644ee7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:31.977295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-579a9f39-d6c0-4e43-8809-f43c70ad69ee req-21006c89-5d59-4cc9-8c71-89a2de644ee7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:31.988502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-579a9f39-d6c0-4e43-8809-f43c70ad69ee req-21006c89-5d59-4cc9-8c71-89a2de644ee7 service nova] Creating event network-vif-plugged:699467db-9a6e-4148-9a8e-aec74ec3b36f for instance 0a569a7b-878e-482c-81f8-da11268e6b1b on hv-cinder-84713 Aug 01 15:29:31.998888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-579a9f39-d6c0-4e43-8809-f43c70ad69ee req-21006c89-5d59-4cc9-8c71-89a2de644ee7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109085 Aug 01 15:29:31.999470 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 387/758] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:32.428762 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-1e79f8c9-1b14-408c-8e51-bd79c2c24ad5 req-d1ac6f44-3d33-4df4-8d4e-f07faebf239a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735761e9-c26a-4eff-a386-d2d552c6a65f", "name": "network-vif-deleted", "tag": "f7f7c786-e86d-4d88-8097-b1c1ab28458d"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:32.438669 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1e79f8c9-1b14-408c-8e51-bd79c2c24ad5 req-d1ac6f44-3d33-4df4-8d4e-f07faebf239a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.439099 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-1e79f8c9-1b14-408c-8e51-bd79c2c24ad5 req-d1ac6f44-3d33-4df4-8d4e-f07faebf239a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.450003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-1e79f8c9-1b14-408c-8e51-bd79c2c24ad5 req-d1ac6f44-3d33-4df4-8d4e-f07faebf239a service nova] Creating event network-vif-deleted:f7f7c786-e86d-4d88-8097-b1c1ab28458d for instance 735761e9-c26a-4eff-a386-d2d552c6a65f on hv-cinder-84713 Aug 01 15:29:32.454763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-1e79f8c9-1b14-408c-8e51-bd79c2c24ad5 req-d1ac6f44-3d33-4df4-8d4e-f07faebf239a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091719 Aug 01 15:29:32.455340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 372/759] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:32.708700 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:32.710384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:32.719527 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.720301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.721692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.722340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.854791 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:32.857486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:32.868857 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.870196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.871444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.871923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.892253 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:32.903961 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e39d70f1-d7c7-42b7-a92b-6227950dc785 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1362 microversion: 2.1 time: 0.203296 Aug 01 15:29:32.904550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 388/760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:32 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:32.912041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:32.912551 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:32.913274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lazy-loading 'fault' on Instance uuid 735761e9-c26a-4eff-a386-d2d552c6a65f {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:29:32.955732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:32.963900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a31251c9-017c-4c31-bfca-29a5269ed083 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 200 len: 1311 microversion: 2.1 time: 0.113868 Aug 01 15:29:32.964496 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 373/761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:32 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:33.928240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:33.928783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:33.935757 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:33.936203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:33.936977 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:33.937414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:33.984998 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:33.985611 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 735761e9-c26a-4eff-a386-d2d552c6a65f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:33.993346 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:33.993812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:33.994606 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:33.995372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.012594 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] HTTP exception thrown: Instance 735761e9-c26a-4eff-a386-d2d552c6a65f could not be found. Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Request method failure captured: Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f HTTP/1.1 Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AOu_gdPJh0fnK6IS6_RTfqlgP9yrCVUGQhjW_TZeS1pFWe7vx8I5l9_sgQyQZoDiqSD5GtGFTLQuG5OUSscK7EY_2AKImIIGZJWxUiBnAzw94Vx0O3XIMK_l0OwZ2sdoCKY_nEhejN9WsqralWbhs4hTuS-P0k6e3k4fdszvGJ9K4 Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:29:34.014330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}] Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 6f852249c66a4f8986d7a63a957ec91c Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 735761e9-c26a-4eff-a386-d2d552c6a65f could not be found. Aug 01 15:29:34.015925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '735761e9-c26a-4eff-a386-d2d552c6a65f'} Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 735761e9-c26a-4eff-a386-d2d552c6a65f could not be found. Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:34.016883 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 735761e9-c26a-4eff-a386-d2d552c6a65f could not be found. Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 735761e9-c26a-4eff-a386-d2d552c6a65f could not be found. Aug 01 15:29:34.018245 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:34.019540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Returning 404 to user: Instance 735761e9-c26a-4eff-a386-d2d552c6a65f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:34.019540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2ea3f06b-3dda-4afe-85a1-66997ad4070d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f" status: 404 len: 111 microversion: 2.1 time: 0.034692 Aug 01 15:29:34.019540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 374/762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:33 2022] GET /compute/v2.1/servers/735761e9-c26a-4eff-a386-d2d552c6a65f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:29:34.025983 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:34.026486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:34.033370 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.033693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.034628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.035074 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.063116 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:29:34.089571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:34.097658 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-49e6da96-f657-4fbc-9ecb-c0f89b6b3d2d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1548 microversion: 2.1 time: 0.174659 Aug 01 15:29:34.098646 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 389/763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:33 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:34.125752 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d7942cc-a875-4e30-bbf4-5366ec0eefd6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:34.126376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d7942cc-a875-4e30-bbf4-5366ec0eefd6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:34.133476 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d7942cc-a875-4e30-bbf4-5366ec0eefd6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.133966 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d7942cc-a875-4e30-bbf4-5366ec0eefd6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.134980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d7942cc-a875-4e30-bbf4-5366ec0eefd6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.135421 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d7942cc-a875-4e30-bbf4-5366ec0eefd6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.162427 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5f242233-e327-4de7-81f2-24c4d5b9c433 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 204 len: 0 microversion: 2.1 time: 0.139803 Aug 01 15:29:34.162995 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 375/764] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:29:34 2022] DELETE /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:29:34.179516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:34.180132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:34.186189 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.186637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.187414 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:34.187839 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:34.217374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d7942cc-a875-4e30-bbf4-5366ec0eefd6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100979 Aug 01 15:29:34.218368 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 390/765] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:29:34 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:29:34.343840 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:34.351805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-87a43ed6-042a-457e-80e9-2b7a8efe175d tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.176595 Aug 01 15:29:34.352383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 376/766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:34 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:35.210058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-c87daf15-c3a7-4255-ade4-97f05bf391a7 req-a03ec9f5-e7c9-4196-8294-072e2ed1ef4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a569a7b-878e-482c-81f8-da11268e6b1b", "tag": "699467db-9a6e-4148-9a8e-aec74ec3b36f"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:35.219870 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c87daf15-c3a7-4255-ade4-97f05bf391a7 req-a03ec9f5-e7c9-4196-8294-072e2ed1ef4b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:35.220735 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c87daf15-c3a7-4255-ade4-97f05bf391a7 req-a03ec9f5-e7c9-4196-8294-072e2ed1ef4b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:35.233318 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-c87daf15-c3a7-4255-ade4-97f05bf391a7 req-a03ec9f5-e7c9-4196-8294-072e2ed1ef4b service nova] Creating event network-changed:699467db-9a6e-4148-9a8e-aec74ec3b36f for instance 0a569a7b-878e-482c-81f8-da11268e6b1b on hv-cinder-84713 Aug 01 15:29:35.238842 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-c87daf15-c3a7-4255-ade4-97f05bf391a7 req-a03ec9f5-e7c9-4196-8294-072e2ed1ef4b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033347 Aug 01 15:29:35.239618 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 391/767] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:35.374693 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:35.375307 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:35.385355 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:35.386255 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:35.387313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:35.387937 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:35.558515 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:35.566108 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0a3d573f-cad1-4cba-97af-705f87be8cec tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.195421 Aug 01 15:29:35.566678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 377/768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:35 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:36.588991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:36.589802 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:36.596257 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:36.596780 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:36.597586 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:36.598051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:36.742180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:36.750098 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-957c355a-cad9-405b-ac16-7a5d0db0a58e tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.165874 Aug 01 15:29:36.750677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 392/769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:36 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:37.772910 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:37.773552 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:37.780988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:37.781444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:37.782275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:37.782716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:37.927719 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:37.935656 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d6df7583-443e-45ce-84d4-28336824da1c tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.167678 Aug 01 15:29:37.936208 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 378/770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:37 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:38.957222 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:38.957905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:38.965235 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:38.965689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:38.966493 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:38.966930 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:39.100670 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:39.108700 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9b00cef8-689c-4259-ae26-fc19dbea5c84 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.155761 Aug 01 15:29:39.109269 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 393/771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:38 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:40.130690 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:40.131340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:40.137764 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:40.138264 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:40.139009 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:40.139440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:40.154557 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:40.381704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f852249c66a4f8986d7a63a957ec91c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a359662d2a444976af8b1b9cc351edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:40.390575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0be5e256-390f-47bb-b38c-0405903795e6 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 200 len: 1521 microversion: 2.1 time: 0.264442 Aug 01 15:29:40.391156 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 379/772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:40 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:40.786866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-8b51c992-1fbe-412e-93e5-65b2d42fbbac req-151c2646-81b6-4dd4-b756-b815039eb65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf39c9-3133-40e5-8942-df02938d1af6", "name": "network-vif-deleted", "tag": "fdcf0275-3209-4cb4-8c4b-fe74fbdf8093"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:40.798771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8b51c992-1fbe-412e-93e5-65b2d42fbbac req-151c2646-81b6-4dd4-b756-b815039eb65b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:40.799713 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8b51c992-1fbe-412e-93e5-65b2d42fbbac req-151c2646-81b6-4dd4-b756-b815039eb65b service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:40.816295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-8b51c992-1fbe-412e-93e5-65b2d42fbbac req-151c2646-81b6-4dd4-b756-b815039eb65b service nova] Creating event network-vif-deleted:fdcf0275-3209-4cb4-8c4b-fe74fbdf8093 for instance 9acf39c9-3133-40e5-8942-df02938d1af6 on hv-cinder-84713 Aug 01 15:29:40.823551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-8b51c992-1fbe-412e-93e5-65b2d42fbbac req-151c2646-81b6-4dd4-b756-b815039eb65b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046236 Aug 01 15:29:40.824481 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 394/773] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:41.250479 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48cab6aa-faec-4c10-926a-9b3b9a5336fe"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:41.252891 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:41.266554 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.267015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.267900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.268330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.354000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Invalid volume: volume 48cab6aa-faec-4c10-926a-9b3b9a5336fe is already attached to instances: a8374677-0d2b-4e4e-9659-d6c32a495a28 Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments HTTP/1.1 Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 74 Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:29:41.356153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {"volumeAttachment": {"volumeId": "48cab6aa-faec-4c10-926a-9b3b9a5336fe"}} Aug 01 15:29:41.357647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Invalid volume: volume 48cab6aa-faec-4c10-926a-9b3b9a5336fe is already attached to instances: a8374677-0d2b-4e4e-9659-d6c32a495a28 Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'server_id': 'a8374677-0d2b-4e4e-9659-d6c32a495a28', 'body': {'volumeAttachment': {'volumeId': '48cab6aa-faec-4c10-926a-9b3b9a5336fe'}}} Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 48cab6aa-faec-4c10-926a-9b3b9a5336fe is already attached to instances: a8374677-0d2b-4e4e-9659-d6c32a495a28 Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.358443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 48cab6aa-faec-4c10-926a-9b3b9a5336fe is already attached to instances: a8374677-0d2b-4e4e-9659-d6c32a495a28 Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:41.359765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:41.360931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:41.360931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:41.360931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:41.360931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 48cab6aa-faec-4c10-926a-9b3b9a5336fe is already attached to instances: a8374677-0d2b-4e4e-9659-d6c32a495a28 Aug 01 15:29:41.360931 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.362473 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 400 to user: Invalid volume: volume 48cab6aa-faec-4c10-926a-9b3b9a5336fe is already attached to instances: a8374677-0d2b-4e4e-9659-d6c32a495a28 {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:41.363384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1ec76ff7-8d4c-45a0-8c4e-0a14870f4506 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118109 Aug 01 15:29:41.364016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 380/774] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:29:41 2022] POST /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:29:41.412511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:41.413202 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] [instance: 9acf39c9-3133-40e5-8942-df02938d1af6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:41.420085 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.420655 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.421981 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.422468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.436507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] HTTP exception thrown: Instance 9acf39c9-3133-40e5-8942-df02938d1af6 could not be found. Aug 01 15:29:41.436699 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:41.437010 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Request method failure captured: Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 HTTP/1.1 Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AOu_gdPJh0fnK6IS6_RTfqlgP9yrCVUGQhjW_TZeS1pFWe7vx8I5l9_sgQyQZoDiqSD5GtGFTLQuG5OUSscK7EY_2AKImIIGZJWxUiBnAzw94Vx0O3XIMK_l0OwZ2sdoCKY_nEhejN9WsqralWbhs4hTuS-P0k6e3k4fdszvGJ9K4 Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:29:41.438172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a359662d2a444976af8b1b9cc351edb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a359662d2a444976af8b1b9cc351edb9"}]}] Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: a359662d2a444976af8b1b9cc351edb9 Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-742392431 Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 6f852249c66a4f8986d7a63a957ec91c Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-742392431-project Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 9acf39c9-3133-40e5-8942-df02938d1af6 could not be found. Aug 01 15:29:41.439682 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '9acf39c9-3133-40e5-8942-df02938d1af6'} Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acf39c9-3133-40e5-8942-df02938d1af6 could not be found. Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:41.440490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acf39c9-3133-40e5-8942-df02938d1af6 could not be found. Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acf39c9-3133-40e5-8942-df02938d1af6 could not be found. Aug 01 15:29:41.441971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:29:41.443055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] Returning 404 to user: Instance 9acf39c9-3133-40e5-8942-df02938d1af6 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:41.443055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9c09400f-6af4-4b93-92d4-cc5fca20be28 tempest-ServerRescueNegativeTestJSON-742392431 tempest-ServerRescueNegativeTestJSON-742392431-project] 10.222.0.48 "GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6" status: 404 len: 111 microversion: 2.1 time: 0.031390 Aug 01 15:29:41.443055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 395/775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:41 2022] GET /compute/v2.1/servers/9acf39c9-3133-40e5-8942-df02938d1af6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:29:41.443635 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.444459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.444846 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.445279 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.529121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lazy-loading 'services' on Instance uuid a8374677-0d2b-4e4e-9659-d6c32a495a28 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:29:41.605734 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-400387da-d7c6-4b48-9e2e-a1931794fee8 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments/48cab6aa-faec-4c10-926a-9b3b9a5336fe" status: 202 len: 0 microversion: 2.1 time: 0.172951 Aug 01 15:29:41.606603 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 381/776] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:29:41 2022] DELETE /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments/48cab6aa-faec-4c10-926a-9b3b9a5336fe => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:29:41.615175 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e44c4e42-0a8f-4cd3-9666-2c884dde09c3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:41.617324 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e44c4e42-0a8f-4cd3-9666-2c884dde09c3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:41.623791 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44c4e42-0a8f-4cd3-9666-2c884dde09c3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.624331 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44c4e42-0a8f-4cd3-9666-2c884dde09c3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.625058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44c4e42-0a8f-4cd3-9666-2c884dde09c3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:41.625491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e44c4e42-0a8f-4cd3-9666-2c884dde09c3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:41.658888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e44c4e42-0a8f-4cd3-9666-2c884dde09c3 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 Aug 01 15:29:41.659892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 396/777] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:29:41 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:42.673738 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-91f05818-b73d-453b-b491-7a3ab4eb2c95 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:42.676546 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-91f05818-b73d-453b-b491-7a3ab4eb2c95 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:42.683580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91f05818-b73d-453b-b491-7a3ab4eb2c95 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.684287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91f05818-b73d-453b-b491-7a3ab4eb2c95 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:42.685484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91f05818-b73d-453b-b491-7a3ab4eb2c95 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.685972 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-91f05818-b73d-453b-b491-7a3ab4eb2c95 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:42.721088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-91f05818-b73d-453b-b491-7a3ab4eb2c95 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052334 Aug 01 15:29:42.722226 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 382/778] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:29:42 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:29:42.818979 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:42.820068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:42.828580 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.829054 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:42.829874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.830303 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:42.857790 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:29:42.944616 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9b0f2b9-2c8e-40c6-93f3-d094d67a21a1 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 204 len: 0 microversion: 2.1 time: 0.131016 Aug 01 15:29:42.945192 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 397/779] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:29:42 2022] DELETE /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:29:42.953497 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:42.956052 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:42.967053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.967506 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:42.968536 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:42.968966 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:43.112949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:43.119099 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ea36cd04-e94a-4daa-986e-cdd7607010f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1681 microversion: 2.1 time: 0.169505 Aug 01 15:29:43.119679 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 383/780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:42 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:44.141419 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:44.142048 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:44.149042 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:44.149504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:44.150375 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:44.150811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:44.290832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:44.299240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3fc96a63-b8af-43d5-8668-632f3ac1d555 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1681 microversion: 2.1 time: 0.162238 Aug 01 15:29:44.300718 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 398/781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:44 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:45.323538 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:45.325214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:45.334592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:45.336154 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:45.337182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:45.338151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:45.687893 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:45.706150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8500c370-6248-4477-b5a8-974afe2b9745 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 200 len: 1681 microversion: 2.1 time: 0.380534 Aug 01 15:29:45.706150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 384/782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:45 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 1681 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:46.015394 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-fd23c264-5675-4df0-9567-4ce4cd9f20c5 req-2c3c5eb9-939b-4fc6-88bf-bf07d8b74221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8374677-0d2b-4e4e-9659-d6c32a495a28", "name": "network-vif-deleted", "tag": "d353ebb5-f9f0-4ac5-928d-6377628e16cf"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:46.026115 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fd23c264-5675-4df0-9567-4ce4cd9f20c5 req-2c3c5eb9-939b-4fc6-88bf-bf07d8b74221 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:46.026909 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-fd23c264-5675-4df0-9567-4ce4cd9f20c5 req-2c3c5eb9-939b-4fc6-88bf-bf07d8b74221 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:46.043558 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-fd23c264-5675-4df0-9567-4ce4cd9f20c5 req-2c3c5eb9-939b-4fc6-88bf-bf07d8b74221 service nova] Creating event network-vif-deleted:d353ebb5-f9f0-4ac5-928d-6377628e16cf for instance a8374677-0d2b-4e4e-9659-d6c32a495a28 on hv-cinder-84713 Aug 01 15:29:46.050027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-fd23c264-5675-4df0-9567-4ce4cd9f20c5 req-2c3c5eb9-939b-4fc6-88bf-bf07d8b74221 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038322 Aug 01 15:29:46.051066 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 399/783] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:46.723266 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:46.724566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:46.731561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:46.732007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:46.732780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:46.733206 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:46.749008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 HTTP/1.1 Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:29:46.750645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:29:46.752123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'a8374677-0d2b-4e4e-9659-d6c32a495a28'} Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:29:46.752890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:29:46.754357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:29:46.755499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:29:46.755499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9ff2e796-585a-460f-8f8a-0de1fcb7e59c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 404 len: 111 microversion: 2.1 time: 0.033090 Aug 01 15:29:46.755499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 385/784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:46 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:29:46.764899 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b4c57ed-d0b5-4d86-aa6d-1948d684562e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '.version_select at 0x7f0367321700>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:46.788915 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b4c57ed-d0b5-4d86-aa6d-1948d684562e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192532736" status: 202 len: 0 microversion: 2.1 time: 0.027079 Aug 01 15:29:46.790471 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 400/785] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 15:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192532736 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:29:47.528766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-da19ca84-5934-4ced-8637-6562b99d1fd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: .version_select at 0x7f03674e1e50>, body: {"keypair": {"name": "tempest-keypair-552463520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjlGsEHUk+QrmaMOiHQHPYnFN+twTYssTVUpg6vJRtK+cxYDAhY/lWMNH/ia23tGfGVh4KD95lYZNKbBuHPmuopNCeI5cyOVmZ6nNlhvmlk4JY7xWHbmWLkoa5Ksas/QA=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:47.545439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-da19ca84-5934-4ced-8637-6562b99d1fd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:29:47.549124 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-da19ca84-5934-4ced-8637-6562b99d1fd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:29:47.573007 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-da19ca84-5934-4ced-8637-6562b99d1fd6 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048235 Aug 01 15:29:47.573647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 386/786] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:29:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:48.973590 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-373941178", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7ed53a-69a3-4296-8374-cca80fe55475"}], "security_groups": [{"name": "tempest-securitygroup--403169653"}], "key_name": "tempest-keypair-552463520", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:49.138035 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] validate_networks() for [('9b7ed53a-69a3-4296-8374-cca80fe55475', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:29:49.720882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:29:49.721376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:29:49.721969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:29:49.722399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:29:49.722861 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:29:49.732667 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:49.733228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:49.734182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:49.734687 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:49.752375 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:29:49.757166 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Getting quotas for user d79f95d9699b4b0393e14a9212986ad5 and project 9d47732c77c34b63a94b3f682f420416. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:29:49.769479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:29:49.772592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:29:49.823669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f2b23f17-6cdf-416a-8b56-2e06b7628ea5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.854597 Aug 01 15:29:49.824541 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 401/787] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:29:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:29:49.837976 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4143697e-5e76-4cc4-b3ae-f175239d4f73 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:49.838697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4143697e-5e76-4cc4-b3ae-f175239d4f73 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:49.929455 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4143697e-5e76-4cc4-b3ae-f175239d4f73 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:49.939298 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4143697e-5e76-4cc4-b3ae-f175239d4f73 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1240 microversion: 2.1 time: 0.107696 Aug 01 15:29:49.940485 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 387/788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:49 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:50.970227 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:50.973340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:50.985129 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:50.986856 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:50.987866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:50.988588 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:51.070161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:51.078710 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13f9722f-b356-44da-a4aa-89993ba96b5a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1292 microversion: 2.1 time: 0.119807 Aug 01 15:29:51.089710 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 402/789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:50 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1292 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:52.105939 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:52.109317 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:52.114239 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:52.134548 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:52.136386 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:52.137986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:52.140986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:52.247140 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:52.258605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-81f0c992-4952-4bb4-834c-2b3ed0799ade tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1298 microversion: 2.1 time: 0.161533 Aug 01 15:29:52.259592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 388/790] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:52 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:52.966397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-97d7a8f8-a446-452f-883d-c363d745c986 req-75d70a44-7354-4134-b56c-3227f239ac02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbe927f-6246-48cb-9a51-b803fa48e1ee", "tag": "1ef1e444-bd2c-427f-aaeb-ecaba1621e2a"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:52.974501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:52.979404 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-97d7a8f8-a446-452f-883d-c363d745c986 req-75d70a44-7354-4134-b56c-3227f239ac02 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:52.979841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-97d7a8f8-a446-452f-883d-c363d745c986 req-75d70a44-7354-4134-b56c-3227f239ac02 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:52.994217 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-97d7a8f8-a446-452f-883d-c363d745c986 req-75d70a44-7354-4134-b56c-3227f239ac02 service nova] Creating event network-changed:1ef1e444-bd2c-427f-aaeb-ecaba1621e2a for instance ddbe927f-6246-48cb-9a51-b803fa48e1ee on hv-cinder-84713 Aug 01 15:29:53.000113 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-97d7a8f8-a446-452f-883d-c363d745c986 req-75d70a44-7354-4134-b56c-3227f239ac02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037358 Aug 01 15:29:53.000959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 403/791] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:53.281395 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:53.282005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:53.289435 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:53.289934 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:53.290702 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:53.291122 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:53.471090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:53.481067 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-42159cfb-34af-4591-b3d4-3bb4965f0c60 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1365 microversion: 2.1 time: 0.204148 Aug 01 15:29:53.483873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 389/792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:53 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:54.502772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:54.503455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:54.512355 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:54.512807 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:54.513694 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:54.514130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:54.991181 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:55.002392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2f7d6ed5-5a56-4467-ba74-331e8554e6b5 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1365 microversion: 2.1 time: 0.503911 Aug 01 15:29:55.005953 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 404/793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:54 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1365 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:56.025454 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:56.026666 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:56.034025 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:56.034471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:56.035318 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:56.035809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:56.237605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:56.245711 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac3919ce-5c82-419d-a81f-f3b103cc049d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1365 microversion: 2.1 time: 0.224979 Aug 01 15:29:56.246345 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 390/794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:56 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:57.266946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:57.267800 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:57.274853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:57.275303 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:57.276072 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:57.276808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:57.295462 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:57.428767 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:57.436846 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd515c65-7e6e-4a59-aa27-58592a6b6433 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1365 microversion: 2.1 time: 0.173948 Aug 01 15:29:57.437416 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 405/795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:57 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:58.024692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-91b8cf18-513a-402c-98fc-82c958628936 req-f10882d8-4d14-4d60-af8c-a252641e42cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbe927f-6246-48cb-9a51-b803fa48e1ee", "name": "network-vif-plugged", "status": "completed", "tag": "1ef1e444-bd2c-427f-aaeb-ecaba1621e2a"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:29:58.040778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-91b8cf18-513a-402c-98fc-82c958628936 req-f10882d8-4d14-4d60-af8c-a252641e42cf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:58.041225 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-91b8cf18-513a-402c-98fc-82c958628936 req-f10882d8-4d14-4d60-af8c-a252641e42cf service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:58.055075 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-91b8cf18-513a-402c-98fc-82c958628936 req-f10882d8-4d14-4d60-af8c-a252641e42cf service nova] Creating event network-vif-plugged:1ef1e444-bd2c-427f-aaeb-ecaba1621e2a for instance ddbe927f-6246-48cb-9a51-b803fa48e1ee on hv-cinder-84713 Aug 01 15:29:58.060211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-91b8cf18-513a-402c-98fc-82c958628936 req-f10882d8-4d14-4d60-af8c-a252641e42cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040552 Aug 01 15:29:58.060834 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 391/796] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:29:58.268764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-603880bc-e943-4957-b7e7-896cc2099528 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:58.269455 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-603880bc-e943-4957-b7e7-896cc2099528 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:58.276010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603880bc-e943-4957-b7e7-896cc2099528 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:58.276449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603880bc-e943-4957-b7e7-896cc2099528 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:58.277468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603880bc-e943-4957-b7e7-896cc2099528 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:58.277985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603880bc-e943-4957-b7e7-896cc2099528 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:58.302131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-603880bc-e943-4957-b7e7-896cc2099528 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/ips" status: 200 len: 153 microversion: 2.20 time: 0.037390 Aug 01 15:29:58.307463 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 406/797] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 1 15:29:58 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:29:58.464038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:58.465096 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:58.473238 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:58.474191 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:58.475138 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:58.475882 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:58.655871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:58.664734 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-74a93221-fe3a-4bcc-8cb2-70c7e05b8c59 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1365 microversion: 2.1 time: 0.207064 Aug 01 15:29:58.665600 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 392/798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:58 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:29:59.686659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:29:59.687238 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:29:59.694045 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.694493 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.695260 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:29:59.695686 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:29:59.742474 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.765029 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:29:59.832150 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:29:59.840109 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ceedaccf-827a-449d-aa74-29543cd9137b tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1365 microversion: 2.1 time: 0.157320 Aug 01 15:29:59.840664 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 407/799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:29:59 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:00.143455 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:00.144051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:00.147241 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:00.153304 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.153739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.154559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.154984 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.183184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lazy-loading 'flavor' on Instance uuid 1c295d39-1434-4597-a68a-a46cea5899f9 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:30:00.387097 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f403883d-a3f0-4638-9d1a-9408766ae67a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/action" status: 202 len: 0 microversion: 2.20 time: 0.245989 Aug 01 15:30:00.388137 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 393/800] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 15:30:00 2022] POST /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:30:00.398390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:00.399247 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:00.406281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.406726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.407513 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.407941 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.562449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:00.571046 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:00.572522 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:00.573698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2efed310-ad75-43eb-b6dd-f4caeffe6872 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.179621 Aug 01 15:30:00.574317 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 408/801] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:00 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:30:00.866337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:00.866337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:00.870107 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.870537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:00.871381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:00.871813 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:01.005938 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:01.014829 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-28f491ca-6dcb-424d-bcad-8128e130c51e tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1554 microversion: 2.1 time: 0.157376 Aug 01 15:30:01.015460 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 394/802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:00 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:01.035956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74a88b3e-9ab2-46d0-ba85-99521955284d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:01.036603 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74a88b3e-9ab2-46d0-ba85-99521955284d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:01.042896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74a88b3e-9ab2-46d0-ba85-99521955284d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:01.043340 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74a88b3e-9ab2-46d0-ba85-99521955284d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:01.044099 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74a88b3e-9ab2-46d0-ba85-99521955284d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:01.044531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74a88b3e-9ab2-46d0-ba85-99521955284d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:01.126789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74a88b3e-9ab2-46d0-ba85-99521955284d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094617 Aug 01 15:30:01.127860 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 409/803] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 15:30:01 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:01.598653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:01.599339 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:01.606110 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:01.607043 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:01.607878 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:01.608417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:01.883071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:01.892901 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:01.894716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:01.896098 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6dcc37aa-682e-43c7-b093-041f285f5716 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.301345 Aug 01 15:30:01.896658 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 395/804] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:01 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:02.307074 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-59f7301c-31c5-4919-a19f-28de4f29643c req-6e49100a-b4dc-40d3-9956-ecc9617614f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddbe927f-6246-48cb-9a51-b803fa48e1ee", "tag": "1ef1e444-bd2c-427f-aaeb-ecaba1621e2a"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:02.318156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-59f7301c-31c5-4919-a19f-28de4f29643c req-6e49100a-b4dc-40d3-9956-ecc9617614f4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:02.318738 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-59f7301c-31c5-4919-a19f-28de4f29643c req-6e49100a-b4dc-40d3-9956-ecc9617614f4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:02.330798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-59f7301c-31c5-4919-a19f-28de4f29643c req-6e49100a-b4dc-40d3-9956-ecc9617614f4 service nova] Creating event network-changed:1ef1e444-bd2c-427f-aaeb-ecaba1621e2a for instance ddbe927f-6246-48cb-9a51-b803fa48e1ee on hv-cinder-84713 Aug 01 15:30:02.336991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-59f7301c-31c5-4919-a19f-28de4f29643c req-6e49100a-b4dc-40d3-9956-ecc9617614f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 Aug 01 15:30:02.338200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 410/805] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:02.930166 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:02.930990 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:02.941177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:02.942776 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:02.944293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:02.945006 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:03.106179 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:03.109947 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:03.119770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:03.121509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:03.122875 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cd91f9a9-f543-47d3-9f30-caf847b27bf9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.206939 Aug 01 15:30:03.123929 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 396/806] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:02 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:04.148477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:04.149159 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:04.155970 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:04.156420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:04.157193 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:04.157620 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:04.306421 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:04.314377 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:04.315861 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:04.317043 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9de9edc5-1347-46eb-87ae-ab775739f1d8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.173797 Aug 01 15:30:04.318069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 411/807] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:04 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:05.345381 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:05.347553 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:05.356958 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:05.357406 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:05.358212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:05.358645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:05.501288 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:05.510169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:05.511682 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:05.512849 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-582c84a6-f875-40da-a3c1-3396f8941f36 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.172947 Aug 01 15:30:05.513408 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 397/808] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:05 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:06.536268 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:06.536861 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:06.543056 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:06.543578 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:06.544355 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:06.544909 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:06.679923 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:06.688080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:06.689550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:06.690718 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e8b4c1c2-034a-4914-ae55-76064c252b49 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.158677 Aug 01 15:30:06.691274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 412/809] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:06 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:07.716759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:07.717644 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:07.727591 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:07.728046 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:07.728822 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:07.729258 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:07.868575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:07.878022 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:07.879510 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:07.880892 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6da94f15-6b2f-454a-a594-28715b1b0305 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.169631 Aug 01 15:30:07.881301 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 398/810] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:07 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:08.907040 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:08.907621 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:08.914430 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:08.914926 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:08.915688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:08.916116 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:09.053802 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:09.062178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:09.063835 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:09.065044 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-36bc4071-5e96-4eeb-bea0-fab26029fb9d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.162357 Aug 01 15:30:09.065621 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 413/811] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:08 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:10.088862 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:10.089461 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:10.096820 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:10.097252 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:10.098805 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:10.099248 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:10.245462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:10.253774 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:10.255324 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:10.256488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-13450458-ff56-49a2-8585-455113d3b7a0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.171730 Aug 01 15:30:10.257045 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 399/812] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:10 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:11.280733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:11.281390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:11.289298 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:11.289949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:11.290625 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:11.291009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:11.440432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:11.449680 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:11.451792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:11.453108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b70fed1-3ca2-4452-949f-7af53d1a5a91 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.176219 Aug 01 15:30:11.453692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 414/813] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:11 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:12.482531 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:12.483108 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:12.490131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:12.490584 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:12.491344 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:12.491777 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:12.626590 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:12.635113 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:12.636662 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:12.637819 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5aa9fd37-5375-4736-aa64-c9a5b6b21a6d tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.162461 Aug 01 15:30:12.638390 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 400/814] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:12 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:13.660943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:13.661540 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:13.668733 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:13.669218 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:13.670025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:13.670457 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:13.805167 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:13.813420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:13.814963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:13.816154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0095d987-bb48-466d-860d-5d3d5170bf87 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.159290 Aug 01 15:30:13.816720 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 415/815] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:13 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:14.839997 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:14.840580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:14.847552 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:14.848000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:14.848788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:14.849220 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:14.988710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:14.997000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:14.998559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:14.999727 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ec4fe71a-8591-4499-8df4-cd4c650b76d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.163909 Aug 01 15:30:15.000286 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 401/816] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:14 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:16.023704 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:16.024302 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:16.031345 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:16.031791 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:16.032547 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:16.032972 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:16.169042 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:16.177473 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:16.179016 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:16.180259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9c746f3-1f4e-405a-b756-1550aa438a98 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1744 microversion: 2.20 time: 0.160660 Aug 01 15:30:16.180828 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 416/817] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:16 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:17.206153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:17.206793 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:17.213480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:17.213957 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:17.214745 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:17.215170 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:17.595665 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:17.603822 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:17.605331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:17.606532 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1c90e9f5-65b0-4db9-a5aa-aceea685ce35 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1744 microversion: 2.20 time: 0.406530 Aug 01 15:30:17.607209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 402/818] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:17 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1744 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:18.630187 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:18.630793 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:18.638513 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:18.638990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:18.639789 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:18.640240 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:18.781941 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:18.790851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:18.792383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:18.793544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dc3c9222-2a4d-4f9e-bb43-9bd71c5f69bf tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.167387 Aug 01 15:30:18.794142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 417/819] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:18 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:18.882428 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff138d6d-90e0-44f6-9a2d-371247af4fbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:18.882980 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff138d6d-90e0-44f6-9a2d-371247af4fbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:18.889999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff138d6d-90e0-44f6-9a2d-371247af4fbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:18.890445 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff138d6d-90e0-44f6-9a2d-371247af4fbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:18.891203 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff138d6d-90e0-44f6-9a2d-371247af4fbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:18.891626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff138d6d-90e0-44f6-9a2d-371247af4fbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:18.928918 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff138d6d-90e0-44f6-9a2d-371247af4fbb tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/ips" status: 200 len: 146 microversion: 2.1 time: 0.050465 Aug 01 15:30:18.929471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 403/820] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:30:18 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:19.818075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:19.818678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:19.825975 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:19.826797 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:19.827766 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:19.828384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:19.979597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:19.991915 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:19.993576 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:19.995170 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6ccd6a29-d633-4a04-ad6b-8992f8d20323 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.180947 Aug 01 15:30:19.996420 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 418/821] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:19 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:20.180513 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-6215d53a-c90d-4cd0-880d-fc4e49572d6e req-f3671e8d-e8d0-499e-8f2a-529f84884936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c295d39-1434-4597-a68a-a46cea5899f9", "name": "network-vif-plugged", "status": "completed", "tag": "e0b42de4-84fd-4819-a551-2256b22587ca"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:20.195768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6215d53a-c90d-4cd0-880d-fc4e49572d6e req-f3671e8d-e8d0-499e-8f2a-529f84884936 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:20.196796 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6215d53a-c90d-4cd0-880d-fc4e49572d6e req-f3671e8d-e8d0-499e-8f2a-529f84884936 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:20.214569 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-6215d53a-c90d-4cd0-880d-fc4e49572d6e req-f3671e8d-e8d0-499e-8f2a-529f84884936 service nova] Creating event network-vif-plugged:e0b42de4-84fd-4819-a551-2256b22587ca for instance 1c295d39-1434-4597-a68a-a46cea5899f9 on hv-cinder-84713 Aug 01 15:30:20.220729 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-6215d53a-c90d-4cd0-880d-fc4e49572d6e req-f3671e8d-e8d0-499e-8f2a-529f84884936 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043889 Aug 01 15:30:20.221581 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 404/822] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:20.346429 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-15fc1032-ea9f-4167-8755-a6ee4406312c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7831ebfb-1256-4f5a-a95d-6077e08b76df"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:20.349457 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-15fc1032-ea9f-4167-8755-a6ee4406312c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:20.360359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15fc1032-ea9f-4167-8755-a6ee4406312c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:20.361019 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15fc1032-ea9f-4167-8755-a6ee4406312c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:20.362180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15fc1032-ea9f-4167-8755-a6ee4406312c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:20.362769 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15fc1032-ea9f-4167-8755-a6ee4406312c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:20.680796 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-15fc1032-ea9f-4167-8755-a6ee4406312c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338536 Aug 01 15:30:20.681402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 419/823] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:30:20 2022] POST /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:21.019550 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:21.020454 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:21.027517 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:21.028250 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:21.029205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:21.029809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:21.202647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:21.213298 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:21.216792 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:21.218085 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-92572e00-55de-483f-8e01-8983a90534f8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.203218 Aug 01 15:30:21.218868 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 405/824] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:21 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:22.246017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:22.246900 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:22.254539 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:22.255295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:22.256348 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:22.256792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:22.430478 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:22.442728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:22.444162 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:22.445427 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a45c0eb1-3ab7-474b-8315-977dc61df568 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.206329 Aug 01 15:30:22.446041 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 420/825] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:22 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:23.485705 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:23.486330 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:23.488773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=36 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:23.493732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:23.494630 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:23.495611 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:23.496800 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:23.667338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:23.676707 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:23.678385 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:23.679802 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-38957dbc-ba81-4131-8dad-619e275bd764 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.204598 Aug 01 15:30:23.680514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 406/826] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:23 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:23.870862 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:23.872122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:23.885969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:23.886672 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:23.887456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:23.887882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:23.938257 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lazy-loading 'flavor' on Instance uuid 14ec3f25-9dbe-422a-ae74-6376025a9922 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:30:23.995356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:24.080895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c584af70-2302-466b-9224-9ea2f69df377 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "POST /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922/action" status: 202 len: 0 microversion: 2.1 time: 0.221678 Aug 01 15:30:24.085007 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 421/827] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:30:23 2022] POST /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:30:24.091556 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:24.092417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:24.099488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:24.100169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:24.101095 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:24.101731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:24.291760 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:24.309103 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0e2a7404-b07e-4f06-8bec-cd2246ecc209 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.222083 Aug 01 15:30:24.310409 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 407/828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:24 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:24.704841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:24.705998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:24.712207 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=38 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:24.717647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:24.718193 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:24.718940 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:24.719382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:24.905919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:24.924631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:24.927249 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:24.929077 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f1d01fa2-2844-4bee-baca-fd5ae1245290 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.229651 Aug 01 15:30:24.930023 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 422/829] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:24 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:25.332482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:25.333935 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:25.348673 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:25.350006 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:25.350879 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:25.351422 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:25.501341 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:25.510495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d199e440-1e37-4844-b749-4e01d04b8e0a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.183402 Aug 01 15:30:25.522314 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 408/830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:25 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:25.953026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:25.953698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:25.960892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:25.961348 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:25.962157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:25.962730 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:26.265580 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:26.278534 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:26.280577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:26.282168 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db5f8368-8a71-4015-b910-17b33401a84f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.333478 Aug 01 15:30:26.283210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 423/831] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:25 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:26.532878 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:26.533473 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:26.541051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:26.541770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:26.542781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:26.543271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:26.713563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:26.721529 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-83966b3b-9655-4c84-be8d-c44c6150d9be tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.192469 Aug 01 15:30:26.722160 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 409/832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:26 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:30:27.307676 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:27.309196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:27.322063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:27.322929 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:27.324475 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:27.325005 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:27.506384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:27.519835 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:27.521613 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:27.522907 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-108b3464-2dc8-4908-85e9-c5ce0231203a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.219637 Aug 01 15:30:27.523543 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 424/833] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:27 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:27.742538 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:27.743130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:27.750496 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:27.750967 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:27.751705 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:27.752145 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:27.939105 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:27.949891 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e1b8b7da-52a4-4e96-b9d4-b911f971ded0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.211265 Aug 01 15:30:27.950979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 410/834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:27 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:28.420413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b14f5c0d-b05d-468c-87ab-0e567bd6f48e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:28.424114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b14f5c0d-b05d-468c-87ab-0e567bd6f48e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:28.431864 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b14f5c0d-b05d-468c-87ab-0e567bd6f48e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.432369 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b14f5c0d-b05d-468c-87ab-0e567bd6f48e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:28.433046 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b14f5c0d-b05d-468c-87ab-0e567bd6f48e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.433623 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b14f5c0d-b05d-468c-87ab-0e567bd6f48e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:28.466674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b14f5c0d-b05d-468c-87ab-0e567bd6f48e tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050371 Aug 01 15:30:28.467230 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 425/835] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:30:28 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:28.479978 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-161de349-c163-4e77-8b30-210e0acf95cc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:28.480813 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-161de349-c163-4e77-8b30-210e0acf95cc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:28.488324 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-161de349-c163-4e77-8b30-210e0acf95cc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.488818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-161de349-c163-4e77-8b30-210e0acf95cc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:28.489633 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-161de349-c163-4e77-8b30-210e0acf95cc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.490096 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-161de349-c163-4e77-8b30-210e0acf95cc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:28.521162 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-161de349-c163-4e77-8b30-210e0acf95cc tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7831ebfb-1256-4f5a-a95d-6077e08b76df" status: 200 len: 194 microversion: 2.1 time: 0.046728 Aug 01 15:30:28.522251 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 411/836] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 15:30:28 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7831ebfb-1256-4f5a-a95d-6077e08b76df => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:28.547259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:28.547907 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:28.554594 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.555102 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:28.555938 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.556346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:28.698702 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:28.711082 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:28.712557 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:28.713728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2ebe33d7-772c-4234-85a3-4dc92e73bef0 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1739 microversion: 2.20 time: 0.170605 Aug 01 15:30:28.714503 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 426/837] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:28 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:30:28.975109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:28.975716 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:28.985548 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.986205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:28.987334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:28.987913 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:29.162564 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:29.170894 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5bae4348-d02e-4c83-b7f4-60c20546067d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.201928 Aug 01 15:30:29.171459 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 412/838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:28 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:29.743322 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:29.743911 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:29.751100 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:29.751555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:29.752323 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:29.752754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:29.892453 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a03dcc3c-2eb4-4b6f-9c9d-18e6c0dcfe9b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c441e94-b76f-44a3-aeb1-45dd593871c5"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:29.894801 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:29.895965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a03dcc3c-2eb4-4b6f-9c9d-18e6c0dcfe9b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:29.903563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:29.904054 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03dcc3c-2eb4-4b6f-9c9d-18e6c0dcfe9b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:29.904474 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03dcc3c-2eb4-4b6f-9c9d-18e6c0dcfe9b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:29.905057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:29.905255 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03dcc3c-2eb4-4b6f-9c9d-18e6c0dcfe9b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:29.905683 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a03dcc3c-2eb4-4b6f-9c9d-18e6c0dcfe9b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:29.906306 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-20056b64-7524-45ff-81c0-97276e601525 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1721 microversion: 2.20 time: 0.167114 Aug 01 15:30:29.906871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 427/839] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:29 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:30.193351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:30.193914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:30.200616 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:30.201066 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:30.201897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:30.202421 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:30.349677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:30.358450 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95dec381-8773-4033-9366-d0ad34e28f6c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.169003 Aug 01 15:30:30.359244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 428/840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:30 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:30.932681 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:30.933381 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:30.941239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:30.941688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:30.942883 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:30.943336 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:31.083974 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:31.092229 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:31.093721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:31.094914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-641c53d6-b2da-48b8-a31f-55356501239a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1721 microversion: 2.20 time: 0.168241 Aug 01 15:30:31.095477 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 429/841] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:30 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:31.261843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:31.381105 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:31.381736 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:31.398295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:31.399090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:31.400642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:31.401264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:31.450114 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a03dcc3c-2eb4-4b6f-9c9d-18e6c0dcfe9b tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "POST /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.562762 Aug 01 15:30:31.451287 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 413/842] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:30:29 2022] POST /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments => generated 194 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:30:31.596837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:31.607060 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-08bd9ecd-12cb-492f-8eb0-e111945aeddf tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.230147 Aug 01 15:30:31.607633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 430/843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:31 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:30:32.121571 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:32.122331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:32.130608 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.131264 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.132015 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.132444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.180096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-3343fa46-f6ed-4b2e-acd2-c6daf7931f48 req-879747a9-ed21-4a07-8982-bf4c605ebdbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c295d39-1434-4597-a68a-a46cea5899f9", "name": "network-vif-unplugged", "status": "completed", "tag": "e0b42de4-84fd-4819-a551-2256b22587ca"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:32.192051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3343fa46-f6ed-4b2e-acd2-c6daf7931f48 req-879747a9-ed21-4a07-8982-bf4c605ebdbc service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.192491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3343fa46-f6ed-4b2e-acd2-c6daf7931f48 req-879747a9-ed21-4a07-8982-bf4c605ebdbc service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.206355 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.compute.server_external_events [req-3343fa46-f6ed-4b2e-acd2-c6daf7931f48 req-879747a9-ed21-4a07-8982-bf4c605ebdbc service nova] Unable to find a host for instance 1c295d39-1434-4597-a68a-a46cea5899f9. Dropping event network-vif-unplugged {{(pid=117825) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 15:30:32.207234 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-3343fa46-f6ed-4b2e-acd2-c6daf7931f48 req-879747a9-ed21-4a07-8982-bf4c605ebdbc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032070 Aug 01 15:30:32.208681 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 431/844] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 01 15:30:32.284733 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:32.293926 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:32.295409 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:32.296561 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e63e9634-ad84-4e92-8ce1-b8ad34a2080b tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1664 microversion: 2.20 time: 0.179866 Aug 01 15:30:32.297126 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 414/845] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:32 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:32.319035 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2cbab7a7-22b9-46b1-88b8-83c925d476b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05c20a31-2f88-452b-b388-6eca4571df41"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:32.321320 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2cbab7a7-22b9-46b1-88b8-83c925d476b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:32.327729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cbab7a7-22b9-46b1-88b8-83c925d476b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.328170 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cbab7a7-22b9-46b1-88b8-83c925d476b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.328984 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cbab7a7-22b9-46b1-88b8-83c925d476b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.329342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2cbab7a7-22b9-46b1-88b8-83c925d476b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.636109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:32.636710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:32.644126 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2cbab7a7-22b9-46b1-88b8-83c925d476b5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329050 Aug 01 15:30:32.644353 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.644559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.644996 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 432/846] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 1 15:30:32 2022] POST /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-volume_attachments => generated 188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:30:32.645353 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.645752 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.775196 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a8013246-4251-470b-922e-d6c0787338c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:32.775746 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a8013246-4251-470b-922e-d6c0787338c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:32.784060 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8013246-4251-470b-922e-d6c0787338c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.784501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8013246-4251-470b-922e-d6c0787338c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.785344 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8013246-4251-470b-922e-d6c0787338c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:32.785772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a8013246-4251-470b-922e-d6c0787338c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:32.793211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:32.801276 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-efe9bc2f-d6a0-476c-bd2f-8bddb7955d89 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.169200 Aug 01 15:30:32.801902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 415/847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:32 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:32.888818 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:33.039827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a8013246-4251-470b-922e-d6c0787338c5 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-volume_attachments/05c20a31-2f88-452b-b388-6eca4571df41" status: 202 len: 0 microversion: 2.20 time: 0.268853 Aug 01 15:30:33.040486 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 433/848] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 1 15:30:32 2022] DELETE /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-volume_attachments/05c20a31-2f88-452b-b388-6eca4571df41 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:30:33.106351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:33.106919 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:33.115879 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:33.116355 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:33.117131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:33.117592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:33.148721 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117824) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:30:33.220150 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4fca0003-c01d-4921-9168-d8d603dde93f tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "POST /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/action" status: 202 len: 0 microversion: 2.20 time: 0.118087 Aug 01 15:30:33.220788 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 416/849] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 15:30:33 2022] POST /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:30:33.229057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:33.229645 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:33.237212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:33.237652 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:33.238439 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:33.238851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:33.381483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:33.390518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:33.392274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:33.393511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f8e7485-e5ee-4018-a20b-5f99013fa124 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1672 microversion: 2.20 time: 0.168433 Aug 01 15:30:33.394155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 434/850] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:33 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:33.825176 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:33.825950 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:33.832907 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:33.833437 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:33.834318 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:33.834822 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:34.021557 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:34.030218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-29537d88-9064-4f99-89e9-a33e4968c23c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.210070 Aug 01 15:30:34.030804 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 417/851] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:33 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:34.432566 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:34.433178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:34.440219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:34.440667 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:34.441647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:34.442113 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:34.672762 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:34.685142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:34.689274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:34.691699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a55616df-a1fc-4594-8e44-c4b3d190e298 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1674 microversion: 2.20 time: 0.263652 Aug 01 15:30:34.693131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 435/852] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:34 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:35.051696 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:35.052309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:35.059593 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:35.060037 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:35.060824 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:35.061248 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:35.379471 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:35.387989 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7cc1a1e2-e8b6-4145-9d1b-f6c4c90a9c87 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.340235 Aug 01 15:30:35.388600 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 418/853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:35 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:35.718301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:35.718919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:35.726220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:35.726647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:35.727527 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:35.727951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:35.870515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:35.881630 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:35.883344 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:35.884638 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3c2cdc71-742d-4094-be7c-937b7fd5c87a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.170835 Aug 01 15:30:35.885216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 436/854] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:35 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:36.414946 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:36.416100 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:36.425723 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:36.426748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:36.427929 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:36.428625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:36.584797 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:36.593748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-37d2e980-11e6-4f24-b2f4-00ac02bcd9b7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.184354 Aug 01 15:30:36.594495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 419/855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:36 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:36.907764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:36.908808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:36.916101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:36.916684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:36.917521 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:36.918037 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:37.120528 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:37.129287 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:37.130802 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:37.131965 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad4c2398-66a9-4d8e-8f94-a87bc43c1e38 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.228380 Aug 01 15:30:37.132516 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 437/856] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:36 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:37.635750 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:37.638289 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:37.652169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:37.652672 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:37.653546 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:37.654013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:37.827199 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:37.842923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7276d6cc-7f06-48b1-a1dc-83d71b7a5500 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.228765 Aug 01 15:30:37.844109 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 420/857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:37 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:38.156622 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:38.157172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:38.164114 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:38.164484 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:38.165374 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:38.165935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:38.312591 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:38.321665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:38.323182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:38.324397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-450ffc91-1cfc-4c51-8cd9-bd78bde7bebe tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.173023 Aug 01 15:30:38.324963 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 438/858] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:38 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:38.865142 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:38.865961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:38.873507 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:38.873982 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:38.874764 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:38.875196 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:39.046051 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:39.055818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8771fb62-e985-4816-a0e4-50f26cab0360 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.194765 Aug 01 15:30:39.056637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 421/859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:38 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:39.348180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:39.349058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:39.358982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:39.360011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:39.361064 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:39.361826 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:39.546323 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:39.559859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:39.562960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:39.564291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db581c19-c185-402b-a6eb-b742d37d50b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.220317 Aug 01 15:30:39.564917 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 439/860] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:39 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:40.092960 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:40.093625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:40.104771 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:40.105440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:40.106505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:40.107285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:40.299033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-9857ac59-c3c1-4229-be41-4bea8126e95a req-720b768a-d603-4866-8318-f8956e1891b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ec3f25-9dbe-422a-ae74-6376025a9922", "name": "network-vif-unplugged", "status": "completed", "tag": "5b272150-0452-4c62-823d-5973ee6a68f8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:40.347726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-9857ac59-c3c1-4229-be41-4bea8126e95a req-720b768a-d603-4866-8318-f8956e1891b5 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:40.350515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-9857ac59-c3c1-4229-be41-4bea8126e95a req-720b768a-d603-4866-8318-f8956e1891b5 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:40.404237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-9857ac59-c3c1-4229-be41-4bea8126e95a req-720b768a-d603-4866-8318-f8956e1891b5 service nova] Creating event network-vif-unplugged:5b272150-0452-4c62-823d-5973ee6a68f8 for instance 14ec3f25-9dbe-422a-ae74-6376025a9922 on hv-cinder-84713 Aug 01 15:30:40.427906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-9857ac59-c3c1-4229-be41-4bea8126e95a req-720b768a-d603-4866-8318-f8956e1891b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136869 Aug 01 15:30:40.428961 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 440/861] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:40.503852 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:40.515247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-254903ed-a4da-4a16-b71a-57b259380df5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.432068 Aug 01 15:30:40.516806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 422/862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:40 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:40.598311 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:40.602182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:40.614907 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:40.615372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:40.616155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:40.616593 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:40.855632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:40.871409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:40.873449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:40.875875 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cf794ab8-6638-4426-9309-8589a09d33d3 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.287468 Aug 01 15:30:40.877997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 441/863] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:40 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:41.552648 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:41.555016 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:41.568031 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:41.568905 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:41.571420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:41.573153 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:41.748547 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:41.763568 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b41d65b2-e24b-4ca5-898d-454176448f2e tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.211422 Aug 01 15:30:41.764521 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 423/864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:41 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:41.900296 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:41.900912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:41.917158 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:41.919911 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:41.921961 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:41.922525 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:42.085501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:42.094236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:42.095724 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:42.097015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-603a6e7d-87aa-4d20-ab06-dc5ac36ed0b9 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.200969 Aug 01 15:30:42.097512 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 442/865] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:41 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:42.785713 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:42.786354 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:42.795529 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:42.795529 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:42.795529 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:42.795933 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:42.995584 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:43.007731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f1350e76-084f-43d5-9b40-c82ebb1e1876 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.225982 Aug 01 15:30:43.008487 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 424/866] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:42 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:43.121065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:43.121651 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:43.129137 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:43.129649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:43.130394 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:43.130828 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:43.367838 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:43.378631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:43.380559 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:43.382696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-39c03444-e712-4e47-b503-08ce5a738031 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.264972 Aug 01 15:30:43.384004 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 443/867] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:43 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:44.035158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:44.035902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:44.044798 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:44.045320 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:44.046233 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:44.046774 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:44.232044 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:44.241629 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cc685909-5d8d-4bb9-b345-dd6e4b3cdc0f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.214659 Aug 01 15:30:44.242852 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 425/868] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:44 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:44.409878 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:44.412772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:44.424051 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:44.424500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:44.425331 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:44.425965 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:44.594867 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:44.613012 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:44.614571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:44.615812 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9e149e63-01aa-425d-962a-97024ba44c66 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.212117 Aug 01 15:30:44.616571 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 444/869] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:44 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:45.270424 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:45.271146 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:45.278178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:45.278611 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:45.279390 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:45.279817 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:45.435439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:45.445076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9070c442-d164-4e44-a74a-a64b599f7ed8 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.184957 Aug 01 15:30:45.446129 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 426/870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:45 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:45.639572 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:45.640149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:45.647267 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:45.648122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:45.648934 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:45.649366 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:45.786690 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:45.797908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:45.799432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:45.800758 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3b7b35d2-fd95-49d8-ad6d-96a22f65a205 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.165230 Aug 01 15:30:45.801316 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 445/871] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:45 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:46.468263 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:46.468855 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:46.475475 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:46.475915 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:46.476872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:46.477231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:46.521207 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32d0b715-b150-40be-adb8-65ef9cec689c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:46.521716 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-32d0b715-b150-40be-adb8-65ef9cec689c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:46.529863 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d0b715-b150-40be-adb8-65ef9cec689c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:46.536634 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d0b715-b150-40be-adb8-65ef9cec689c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:46.537365 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d0b715-b150-40be-adb8-65ef9cec689c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:46.537852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d0b715-b150-40be-adb8-65ef9cec689c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:46.568214 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-32d0b715-b150-40be-adb8-65ef9cec689c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/ips" status: 200 len: 149 microversion: 2.1 time: 0.050917 Aug 01 15:30:46.570109 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 446/872] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:30:46 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:46.647094 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:46.657622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-02a226ef-48cb-4d29-8250-74bba9dc2c8d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.193969 Aug 01 15:30:46.658276 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 427/873] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:46 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:46.828162 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:46.828780 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:46.845686 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:46.846811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:46.848081 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:46.848830 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.015885 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:47.026956 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:47.028831 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:47.030118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-adec2052-90fd-405a-84d3-df8b1b6e1a1a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.210164 Aug 01 15:30:47.030960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 447/874] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:46 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:47.685204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:47.685925 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:47.692970 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.693701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.694516 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.695085 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.739307 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00e06a1e-4093-4d16-b9bc-66eb6c6ac0d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:47.742266 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00e06a1e-4093-4d16-b9bc-66eb6c6ac0d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:47.753724 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00e06a1e-4093-4d16-b9bc-66eb6c6ac0d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.762068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00e06a1e-4093-4d16-b9bc-66eb6c6ac0d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.763250 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00e06a1e-4093-4d16-b9bc-66eb6c6ac0d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.763858 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00e06a1e-4093-4d16-b9bc-66eb6c6ac0d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.828294 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00e06a1e-4093-4d16-b9bc-66eb6c6ac0d9 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.091879 Aug 01 15:30:47.828983 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 448/875] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:30:47 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:47.870827 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:47.873144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:47.881843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-72468176-bb96-4c02-ad01-e8b79447a3e0 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1568 microversion: 2.1 time: 0.200837 Aug 01 15:30:47.882465 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 428/876] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:47 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:47.903287 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:47.904195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:47.910991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.911646 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.912460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.913065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.960690 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117825) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:30:47.978869 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bf85bd4c-e668-49da-bc5d-55f54adcf17d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "665a4119-b8d2-4a3e-9690-b649f2088ef0"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:47.982285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bf85bd4c-e668-49da-bc5d-55f54adcf17d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:47.990781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf85bd4c-e668-49da-bc5d-55f54adcf17d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.991281 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf85bd4c-e668-49da-bc5d-55f54adcf17d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.992308 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf85bd4c-e668-49da-bc5d-55f54adcf17d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:47.992938 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bf85bd4c-e668-49da-bc5d-55f54adcf17d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:47.998627 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=95 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:48.041824 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d30ddef-92d0-4df2-b6d6-e934a5ee7700 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "POST /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922/action" status: 202 len: 0 microversion: 2.1 time: 0.142781 Aug 01 15:30:48.042933 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 449/877] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:30:47 2022] POST /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:30:48.049615 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-62e22cef-9774-4ff3-a635-0a1c480d1fc8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:48.050301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-62e22cef-9774-4ff3-a635-0a1c480d1fc8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:48.060642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62e22cef-9774-4ff3-a635-0a1c480d1fc8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.061349 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62e22cef-9774-4ff3-a635-0a1c480d1fc8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.062174 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62e22cef-9774-4ff3-a635-0a1c480d1fc8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.062608 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-62e22cef-9774-4ff3-a635-0a1c480d1fc8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.099286 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-62e22cef-9774-4ff3-a635-0a1c480d1fc8 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7831ebfb-1256-4f5a-a95d-6077e08b76df" status: 200 len: 194 microversion: 2.1 time: 0.054430 Aug 01 15:30:48.101991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 450/878] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 15:30:48 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7831ebfb-1256-4f5a-a95d-6077e08b76df => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:48.107397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:48.108134 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:48.115715 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.116291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.117155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.117757 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.347491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:48.353312 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b4975c0-506b-4b5a-ade7-938f1ad8f6f3 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1516 microversion: 2.1 time: 0.250163 Aug 01 15:30:48.354152 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 451/879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:48 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:48.361436 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:48.362059 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:48.385677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.386285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.389275 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.389857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.397454 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bf85bd4c-e668-49da-bc5d-55f54adcf17d tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "POST /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425299 Aug 01 15:30:48.401128 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 429/880] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:30:47 2022] POST /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:48.417178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:48.423635 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:48.441328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.442183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.443711 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:48.447319 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:48.615368 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lazy-loading 'services' on Instance uuid 0a569a7b-878e-482c-81f8-da11268e6b1b {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:30:48.701621 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:48.715845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:48.717598 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:48.719277 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a1bd2044-fd8f-497a-9ffe-7dfef5c3dede tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.364005 Aug 01 15:30:48.720174 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 452/881] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:48 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:48.742575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6923f9da-4a9a-4fe7-9dd1-c42c7a885d8d tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7831ebfb-1256-4f5a-a95d-6077e08b76df" status: 202 len: 0 microversion: 2.1 time: 0.338794 Aug 01 15:30:48.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 430/882] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:30:48 2022] DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7831ebfb-1256-4f5a-a95d-6077e08b76df => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:30:49.376409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:49.377013 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:49.384015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:49.384703 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:49.385499 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:49.385971 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:49.521176 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:49.529139 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-21f20114-cbd4-41b6-8fea-c254e98acc97 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1518 microversion: 2.1 time: 0.156756 Aug 01 15:30:49.529836 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 453/883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:49 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:49.746663 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:49.747341 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:49.754909 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:49.755364 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:49.756139 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:49.756585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:49.904988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:49.915427 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:49.916961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:49.918183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-de971f82-cb08-44ac-a0e8-7aa44595fae8 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.176515 Aug 01 15:30:49.918848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 431/884] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:49 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:50.318316 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-75f9cce0-e01b-4f2d-88d4-5fd68dbe56ac req-4f9dcc35-4862-45d2-9d9d-829bff5b2cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c295d39-1434-4597-a68a-a46cea5899f9", "name": "network-vif-plugged", "status": "completed", "tag": "e0b42de4-84fd-4819-a551-2256b22587ca"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:30:50.328570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-75f9cce0-e01b-4f2d-88d4-5fd68dbe56ac req-4f9dcc35-4862-45d2-9d9d-829bff5b2cc5 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:50.329054 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-75f9cce0-e01b-4f2d-88d4-5fd68dbe56ac req-4f9dcc35-4862-45d2-9d9d-829bff5b2cc5 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:50.342518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-75f9cce0-e01b-4f2d-88d4-5fd68dbe56ac req-4f9dcc35-4862-45d2-9d9d-829bff5b2cc5 service nova] Creating event network-vif-plugged:e0b42de4-84fd-4819-a551-2256b22587ca for instance 1c295d39-1434-4597-a68a-a46cea5899f9 on hv-cinder-84713 Aug 01 15:30:50.347735 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-75f9cce0-e01b-4f2d-88d4-5fd68dbe56ac req-4f9dcc35-4862-45d2-9d9d-829bff5b2cc5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033226 Aug 01 15:30:50.348346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 454/885] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:50.551044 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:50.551644 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:50.559615 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:50.560049 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:50.561006 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:50.561592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:50.924799 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:50.933623 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0f634f21-0100-4717-ba5c-6b3a70995f31 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1518 microversion: 2.1 time: 0.386515 Aug 01 15:30:50.934309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 432/886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:50 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:30:50.949111 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:50.949904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:50.956553 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:50.957002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:50.957772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:50.958225 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:51.091469 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:51.099969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:51.101470 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:51.102753 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2ca83015-5fe0-4b8e-b88b-02aa35acfe23 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.158645 Aug 01 15:30:51.103327 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 455/887] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:50 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:30:51.955566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:51.956316 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:51.963988 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:51.964417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:51.965613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:51.966035 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:52.126397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:52.126905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:52.134648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:52.135101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:52.135755 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:52.138578 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:52.139083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:52.146002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3dedfa99-d358-4b58-8327-8fcf2826acca tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1518 microversion: 2.1 time: 0.194629 Aug 01 15:30:52.150498 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 433/888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:51 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:52.293995 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:52.306962 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:52.309003 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:52.310303 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8f0d868a-ffd5-4bdd-b441-ee3df567a675 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1730 microversion: 2.20 time: 0.188656 Aug 01 15:30:52.310866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 456/889] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:52 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:30:53.169595 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:53.170542 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:53.179621 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:53.180224 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:53.181278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:53.181835 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:53.321518 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:53.329582 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f8639577-de49-484d-b5ee-7652441a8aa1 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1518 microversion: 2.1 time: 0.165364 Aug 01 15:30:53.330599 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 434/890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:53 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:53.333448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:53.334063 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:53.341310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:53.341751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:53.342534 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:53.342960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:53.479880 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:53.493664 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:53.496699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:53.499506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-98624804-4c3c-46b4-8097-1a3050f94b68 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1717 microversion: 2.20 time: 0.169872 Aug 01 15:30:53.500796 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 457/891] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:30:53 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:30:54.352419 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:54.353115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:54.355514 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:54.361720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:54.362205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:54.363004 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:54.363441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:54.537562 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:54.548739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d0d8b60-f069-409d-9290-bdd10c3c1fb7 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1518 microversion: 2.1 time: 0.199981 Aug 01 15:30:54.549484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 435/892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:54 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:55.112886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:55.113430 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:55.116155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:55.121496 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:55.121990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:55.122728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:55.123152 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:55.215681 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lazy-loading 'services' on Instance uuid ddbe927f-6246-48cb-9a51-b803fa48e1ee {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:30:55.294384 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7aa41e7d-f647-4c48-9753-b2490969c3e0 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments/665a4119-b8d2-4a3e-9690-b649f2088ef0" status: 202 len: 0 microversion: 2.1 time: 0.185237 Aug 01 15:30:55.295017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 458/893] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:30:55 2022] DELETE /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments/665a4119-b8d2-4a3e-9690-b649f2088ef0 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:30:55.307000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2a43d9bf-ba88-4f51-8b24-93f453c8af7c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:55.309285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2a43d9bf-ba88-4f51-8b24-93f453c8af7c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:55.315591 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a43d9bf-ba88-4f51-8b24-93f453c8af7c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:55.316040 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a43d9bf-ba88-4f51-8b24-93f453c8af7c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:55.316798 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a43d9bf-ba88-4f51-8b24-93f453c8af7c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:55.317228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2a43d9bf-ba88-4f51-8b24-93f453c8af7c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:55.347055 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2a43d9bf-ba88-4f51-8b24-93f453c8af7c tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Aug 01 15:30:55.347580 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 436/894] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:30:55 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:30:55.571376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:55.572065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:55.585210 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:55.585678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:55.586512 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:55.587011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:55.851572 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:55.860309 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-24003404-056c-4443-a330-c8fdaa76154a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1518 microversion: 2.1 time: 0.293657 Aug 01 15:30:55.861346 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 459/895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:55 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:56.307053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3253dfdd-0059-40f8-8ca2-e8166056e6da tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:56.307612 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3253dfdd-0059-40f8-8ca2-e8166056e6da tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:56.314105 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3253dfdd-0059-40f8-8ca2-e8166056e6da tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.314592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3253dfdd-0059-40f8-8ca2-e8166056e6da tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:56.315410 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3253dfdd-0059-40f8-8ca2-e8166056e6da tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.315840 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3253dfdd-0059-40f8-8ca2-e8166056e6da tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:56.359927 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-76c9e7ef-1f74-47be-bdca-07d98b96d340 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:56.361069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3253dfdd-0059-40f8-8ca2-e8166056e6da tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7c441e94-b76f-44a3-aeb1-45dd593871c5" status: 200 len: 194 microversion: 2.1 time: 0.058017 Aug 01 15:30:56.361688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 437/896] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 15:30:56 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7c441e94-b76f-44a3-aeb1-45dd593871c5 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:30:56.362345 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-76c9e7ef-1f74-47be-bdca-07d98b96d340 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:56.369437 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76c9e7ef-1f74-47be-bdca-07d98b96d340 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.369909 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76c9e7ef-1f74-47be-bdca-07d98b96d340 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:56.370691 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76c9e7ef-1f74-47be-bdca-07d98b96d340 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.371097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76c9e7ef-1f74-47be-bdca-07d98b96d340 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:56.372159 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:56.372653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:56.378806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.379253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:56.380018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.380505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:56.400981 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-76c9e7ef-1f74-47be-bdca-07d98b96d340 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Aug 01 15:30:56.401566 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 460/897] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:30:56 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:30:56.473289 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lazy-loading 'services' on Instance uuid 0a569a7b-878e-482c-81f8-da11268e6b1b {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:30:56.560996 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-45eb6dec-9d42-4a3e-816e-1f4610c94604 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7c441e94-b76f-44a3-aeb1-45dd593871c5" status: 202 len: 0 microversion: 2.1 time: 0.192448 Aug 01 15:30:56.561675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 438/898] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:30:56 2022] DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments/7c441e94-b76f-44a3-aeb1-45dd593871c5 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:30:56.883229 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:56.883695 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:56.890287 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.890863 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:56.891653 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:56.892272 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.048194 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:57.056342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-85af6ca2-2989-4305-9c6d-28acda2b89e5 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.177480 Aug 01 15:30:57.056924 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 461/899] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:56 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:57.414682 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4272df5-5eb7-49ae-808f-90600d4a3cdd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:57.417094 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4272df5-5eb7-49ae-808f-90600d4a3cdd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:57.430559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4272df5-5eb7-49ae-808f-90600d4a3cdd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.431005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4272df5-5eb7-49ae-808f-90600d4a3cdd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.431792 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4272df5-5eb7-49ae-808f-90600d4a3cdd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.432227 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4272df5-5eb7-49ae-808f-90600d4a3cdd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.466123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4272df5-5eb7-49ae-808f-90600d4a3cdd tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056415 Aug 01 15:30:57.466917 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 439/900] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:30:57 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:30:57.540291 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:57.541453 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:57.548038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.548492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.549443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.550057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.578461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:30:57.673739 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27a12506-fce1-4889-be0b-20ae02c703f4 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 204 len: 0 microversion: 2.1 time: 0.138101 Aug 01 15:30:57.678610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 462/901] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:30:57 2022] DELETE /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:30:57.683439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:57.684248 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:57.705737 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.706567 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.707545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.708295 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.764145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-436d2a20-28cf-40b8-a331-7dd837b36d13 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:57.766569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-436d2a20-28cf-40b8-a331-7dd837b36d13 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:57.773001 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-436d2a20-28cf-40b8-a331-7dd837b36d13 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.773506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-436d2a20-28cf-40b8-a331-7dd837b36d13 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.774297 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-436d2a20-28cf-40b8-a331-7dd837b36d13 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.774728 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-436d2a20-28cf-40b8-a331-7dd837b36d13 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.805052 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-436d2a20-28cf-40b8-a331-7dd837b36d13 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045321 Aug 01 15:30:57.805624 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 463/902] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:30:57 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:30:57.857686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:57.862024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ed51ea3e-25d0-4c18-bff0-01cb4c186875 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1679 microversion: 2.1 time: 0.182838 Aug 01 15:30:57.862763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 440/903] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:57 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:30:57.920839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-75de7722-ebfc-4dc6-ba3a-c3924b88e930 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:57.923099 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-75de7722-ebfc-4dc6-ba3a-c3924b88e930 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:57.929509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75de7722-ebfc-4dc6-ba3a-c3924b88e930 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.929995 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75de7722-ebfc-4dc6-ba3a-c3924b88e930 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.930760 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75de7722-ebfc-4dc6-ba3a-c3924b88e930 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:57.931197 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-75de7722-ebfc-4dc6-ba3a-c3924b88e930 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:57.933916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:57.964506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-75de7722-ebfc-4dc6-ba3a-c3924b88e930 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047685 Aug 01 15:30:57.965060 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 464/904] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:30:57 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:30:58.027983 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:58.028400 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:58.035455 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.035633 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:58.036301 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.036739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:58.064977 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:30:58.077161 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:58.077764 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:58.084954 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.085402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:58.086341 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.086740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:58.099208 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:30:58.145841 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9c24bd25-1b65-4524-9a48-7423913524ba tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 204 len: 0 microversion: 2.1 time: 0.121898 Aug 01 15:30:58.146432 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 441/905] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:30:58 2022] DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:30:58.154964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:58.155652 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:58.161736 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.162210 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:58.162973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.163401 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:58.272426 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:58.280919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-637cdc39-8195-4a02-a4d4-8f292894e0dc tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.207594 Aug 01 15:30:58.281500 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 465/906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:58 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:30:58.318352 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:58.326929 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ff91f6c3-9212-4163-b18a-d50e80b99743 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1673 microversion: 2.1 time: 0.175911 Aug 01 15:30:58.327523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 442/907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:58 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:30:58.884461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:58.885072 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:58.892383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.892818 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:58.893582 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:58.894048 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:59.105483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:59.113317 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29308539-fec5-44d7-b929-b988ac8707ac tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1679 microversion: 2.1 time: 0.233091 Aug 01 15:30:59.113924 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 466/908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:58 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:59.302119 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:59.302724 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:59.309813 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:59.310289 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:59.311077 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:59.311504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:59.349124 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:30:59.349632 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:30:59.356678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:59.357129 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:59.358117 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:30:59.358552 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:30:59.496477 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:59.504384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aecc7a20-9992-4a16-a7af-fa6733c9ca1a tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.206215 Aug 01 15:30:59.504967 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 443/909] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:59 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:30:59.525389 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:30:59.533274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50770572-e160-4af9-b496-a1676ad241f7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1673 microversion: 2.1 time: 0.188463 Aug 01 15:30:59.533872 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 467/910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:30:59 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:00.137170 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:00.137686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:00.144579 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:00.145151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:00.145973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:00.146412 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:00.281502 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:00.289560 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7bc6d1c3-27c7-4ba1-9d23-8fc6fe1e7859 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1679 microversion: 2.1 time: 0.156711 Aug 01 15:31:00.290219 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 444/911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:00 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:00.526770 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:00.527400 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:00.534333 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:00.534780 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:00.535551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:00.535982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:00.555956 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:00.556596 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:00.563834 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:00.564297 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:00.565057 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:00.565496 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:00.745647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:00.752365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:00.753882 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a3be89e8-a279-4fff-a671-f1abd4a9c9ed tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.231450 Aug 01 15:31:00.754575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 468/912] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:00 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:00.763738 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e9d3d2d4-6528-488b-85f8-ba2c8a568dc7 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1673 microversion: 2.1 time: 0.212087 Aug 01 15:31:00.764347 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 445/913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:00 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1673 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:01.311548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:01.313597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:01.320316 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:01.320772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:01.321562 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:01.322035 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:01.652449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:01.660370 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-47b655c9-bb40-43e7-9fce-b89ee35a2682 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1679 microversion: 2.1 time: 0.352733 Aug 01 15:31:01.660945 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 469/914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:01 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1679 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:01.782444 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:01.783504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:01.795280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:01.795886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:01.800100 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:01.800545 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:01.801601 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:01.802185 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:01.803635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:01.804090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:01.805101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:01.805531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:02.517175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:02.520985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:02.525993 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-809bc0b1-3a47-4c39-9e5b-e4e4fca3dd27 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.749107 Aug 01 15:31:02.526575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 446/915] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:01 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:02.541010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e4206284-b196-4df9-adf2-7444a0de9426 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1673 microversion: 2.1 time: 0.749717 Aug 01 15:31:02.541635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 470/916] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:01 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1673 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:02.684467 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:02.685458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:02.696197 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:02.696950 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:02.697701 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:02.698372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:02.811771 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79f95d9699b4b0393e14a9212986ad5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47732c77c34b63a94b3f682f420416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:02.837012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-41dcb2fa-f080-4aa2-9012-5cde85ebc65a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 200 len: 1612 microversion: 2.1 time: 0.158699 Aug 01 15:31:02.838440 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 447/917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:02 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 1612 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:31:02.908456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-34c602a6-a252-4332-ab34-d230180f006d req-c9a211d8-6054-41ca-baff-c882d2f7ec6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbe927f-6246-48cb-9a51-b803fa48e1ee", "name": "network-vif-deleted", "tag": "1ef1e444-bd2c-427f-aaeb-ecaba1621e2a"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:02.926136 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-34c602a6-a252-4332-ab34-d230180f006d req-c9a211d8-6054-41ca-baff-c882d2f7ec6e service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:02.926991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-34c602a6-a252-4332-ab34-d230180f006d req-c9a211d8-6054-41ca-baff-c882d2f7ec6e service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:02.944145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-34c602a6-a252-4332-ab34-d230180f006d req-c9a211d8-6054-41ca-baff-c882d2f7ec6e service nova] Creating event network-vif-deleted:1ef1e444-bd2c-427f-aaeb-ecaba1621e2a for instance ddbe927f-6246-48cb-9a51-b803fa48e1ee on hv-cinder-84713 Aug 01 15:31:02.952960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-34c602a6-a252-4332-ab34-d230180f006d req-c9a211d8-6054-41ca-baff-c882d2f7ec6e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050407 Aug 01 15:31:02.954966 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 471/918] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:03.548418 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:03.549038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:03.555785 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:03.556463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:03.564809 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:03.565490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:03.568667 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:03.569445 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:03.575657 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:03.580923 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:03.582070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:03.582669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:03.650122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:03.650461 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:03.651239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lazy-loading 'fault' on Instance uuid 0a569a7b-878e-482c-81f8-da11268e6b1b {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:31:03.823606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93d86ae4501e43d59d172d2e7acfdd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b8e7cb5fc4a4e598d27e51122265bda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:03.831735 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c6971894-2dcb-4ae4-a5c1-78b626c6afe5 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 200 len: 1327 microversion: 2.1 time: 0.272599 Aug 01 15:31:03.835731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 472/919] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:03 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 1327 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:03.859104 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:03.860356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:03.861359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:03.871655 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:03.872116 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:03.872964 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:03.876244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:03.877999 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-79fc3366-8c52-45d1-8587-b7d3d6c2366f tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.333933 Aug 01 15:31:03.879258 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 448/920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:03 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:03.912456 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee HTTP/1.1 Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:03.915820 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:03.917888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'ddbe927f-6246-48cb-9a51-b803fa48e1ee'} Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:03.918665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:03.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:03.921080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:03.921080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-34466194-0848-4b41-80cc-44d4e881feda tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 404 len: 111 microversion: 2.1 time: 0.061531 Aug 01 15:31:03.921080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 473/921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:03 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:31:03.929901 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a56e7a99-3a9b-4814-a5f8-bfa7a6ba4141 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '.version_select at 0x7f036739af70>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:03.952801 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a56e7a99-3a9b-4814-a5f8-bfa7a6ba4141 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552463520" status: 202 len: 0 microversion: 2.1 time: 0.026870 Aug 01 15:31:03.958182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 449/922] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 15:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552463520 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:31:04.861853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:04.862513 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:04.870166 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:04.870622 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:04.871402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:04.871839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:04.886975 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] HTTP exception thrown: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Request method failure captured: Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b HTTP/1.1 Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AWP30hUQfhi2C8UkMpSx3bh0fLBSt0O2p0psKO_yKogOEjhYRK_f5htYXhJ3XovQTE1U1KdFkiImC9TSL3zIAjeF6d64CNQqmmTi3LODFrFP0Nd3TPFSPu7anJbUsxiAXRi42eAZr33ma94u39p6P2GoCnFUu3_9O0q7_wY9hJJyQ Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:04.889127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}] Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 93d86ae4501e43d59d172d2e7acfdd54 Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:04.890854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '0a569a7b-878e-482c-81f8-da11268e6b1b'} Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:04.891904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:04.893751 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:04.895994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Returning 404 to user: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:04.895994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-26d2e018-2858-4ac9-b37d-984ca86faff6 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 404 len: 111 microversion: 2.1 time: 0.033449 Aug 01 15:31:04.895994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 474/923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:04 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:04.901577 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2288e0dd-2839-4439-a3bc-e25b1fe5c286 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '.version_select at 0x7f03672f6a60>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:04.908279 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:04.909443 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:04.918491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:04.919324 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:04.919777 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:04.920242 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:04.925892 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2288e0dd-2839-4439-a3bc-e25b1fe5c286 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-595044583" status: 202 len: 0 microversion: 2.1 time: 0.028756 Aug 01 15:31:04.926537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 450/924] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 15:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-595044583 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:31:05.010847 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-41632d3b-55bf-4fca-8cbf-36deabf5fe9b req-d2bdc5bb-a77a-438e-84f2-f0decd4cec5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a569a7b-878e-482c-81f8-da11268e6b1b", "name": "network-vif-deleted", "tag": "699467db-9a6e-4148-9a8e-aec74ec3b36f"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:05.021489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-41632d3b-55bf-4fca-8cbf-36deabf5fe9b req-d2bdc5bb-a77a-438e-84f2-f0decd4cec5a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:05.021977 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-41632d3b-55bf-4fca-8cbf-36deabf5fe9b req-d2bdc5bb-a77a-438e-84f2-f0decd4cec5a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:05.034334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-41632d3b-55bf-4fca-8cbf-36deabf5fe9b req-d2bdc5bb-a77a-438e-84f2-f0decd4cec5a service nova] Creating event network-vif-deleted:699467db-9a6e-4148-9a8e-aec74ec3b36f for instance 0a569a7b-878e-482c-81f8-da11268e6b1b on hv-cinder-84713 Aug 01 15:31:05.040446 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-41632d3b-55bf-4fca-8cbf-36deabf5fe9b req-d2bdc5bb-a77a-438e-84f2-f0decd4cec5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Aug 01 15:31:05.040446 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 451/925] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:05.130013 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:05.139097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c51aaeae-16a0-4739-986e-f41db664c7de tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.235635 Aug 01 15:31:05.139647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 475/926] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:04 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:05.747279 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:05.747855 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:05.759423 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:05.759882 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:05.760910 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:05.761362 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:05.776417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee HTTP/1.1 Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:05.778757 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.780132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'ddbe927f-6246-48cb-9a51-b803fa48e1ee'} Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:05.780953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.782340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.784018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:05.784018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b1d9ffe3-ec76-4ec2-8af2-da764fd89ff2 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 404 len: 111 microversion: 2.1 time: 0.036802 Aug 01 15:31:05.784018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 452/927] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:31:05 2022] DELETE /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:05.789523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:05.790171 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: ddbe927f-6246-48cb-9a51-b803fa48e1ee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:05.796718 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:05.797131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:05.798152 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:05.798553 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:05.813928 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee HTTP/1.1 Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:05.815482 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.817280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'ddbe927f-6246-48cb-9a51-b803fa48e1ee'} Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:05.818149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. Aug 01 15:31:05.819844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:05.822011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance ddbe927f-6246-48cb-9a51-b803fa48e1ee could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:05.822011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e9bc47e-d0cb-4879-baa7-7ec21b401083 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee" status: 404 len: 111 microversion: 2.1 time: 0.032322 Aug 01 15:31:05.822011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 476/928] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:05 2022] GET /compute/v2.1/servers/ddbe927f-6246-48cb-9a51-b803fa48e1ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:06.162384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:06.163029 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:06.170678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:06.171152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:06.172152 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:06.172575 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:06.324731 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:06.335550 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8531499a-9aa8-42a5-8b5c-9b826b6cb024 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.177010 Aug 01 15:31:06.336232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 453/929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:06 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:06.996045 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:06.996543 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:07.003670 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.004142 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.004920 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.005582 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.021493 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 HTTP/1.1 Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:07.024104 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.027156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'a8374677-0d2b-4e4e-9659-d6c32a495a28'} Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:07.028596 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.030075 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.031597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:07.031597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19f18ab9-5706-4f91-92a5-b1bd08046690 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 404 len: 111 microversion: 2.1 time: 0.033363 Aug 01 15:31:07.031597 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 477/930] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:31:06 2022] DELETE /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:07.039708 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:07.040304 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: a8374677-0d2b-4e4e-9659-d6c32a495a28] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:07.048313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.049072 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.050388 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.050956 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.065632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 HTTP/1.1 Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:07.067302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.068979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'a8374677-0d2b-4e4e-9659-d6c32a495a28'} Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:07.070061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. Aug 01 15:31:07.071906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.073266 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance a8374677-0d2b-4e4e-9659-d6c32a495a28 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:07.073266 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6ba0d91c-5866-42d6-90af-62c2630a6984 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28" status: 404 len: 111 microversion: 2.1 time: 0.033003 Aug 01 15:31:07.073266 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 454/931] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:07 2022] GET /compute/v2.1/servers/a8374677-0d2b-4e4e-9659-d6c32a495a28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:31:07.079817 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:07.080338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:07.086688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.087136 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.087906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.088341 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.103330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f HTTP/1.1 Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:07.104894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.106451 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '721bdce3-df3b-4543-8e84-eb63f3da2b7f'} Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:07.107281 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.108602 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.110115 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:07.110115 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1d835afc-132d-4ed7-b19a-683bb01483a7 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 404 len: 111 microversion: 2.1 time: 0.030875 Aug 01 15:31:07.110115 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 478/932] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:31:07 2022] DELETE /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:07.115449 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:07.116207 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 721bdce3-df3b-4543-8e84-eb63f3da2b7f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:07.123248 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.123734 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.124508 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.124953 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.140132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f HTTP/1.1 Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:07.141588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.143267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '721bdce3-df3b-4543-8e84-eb63f3da2b7f'} Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:07.147285 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. Aug 01 15:31:07.148803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:07.150293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance 721bdce3-df3b-4543-8e84-eb63f3da2b7f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:07.150293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4a2c1f6b-4a4e-4fc1-af34-37b90c1d0151 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f" status: 404 len: 111 microversion: 2.1 time: 0.032075 Aug 01 15:31:07.150293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 455/933] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:07 2022] GET /compute/v2.1/servers/721bdce3-df3b-4543-8e84-eb63f3da2b7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:07.360591 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:07.361513 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:07.371570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.372329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.373592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:07.374351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:07.536217 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:07.546068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4f1c142-e6bb-4768-b17d-716243b08ae2 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.191768 Aug 01 15:31:07.546637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 479/934] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:07 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:08.096732 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:08.097312 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:08.104619 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.105071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.105887 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.106325 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.121113 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] HTTP exception thrown: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Request method failure captured: Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b HTTP/1.1 Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AWP30hUQfhi2C8UkMpSx3bh0fLBSt0O2p0psKO_yKogOEjhYRK_f5htYXhJ3XovQTE1U1KdFkiImC9TSL3zIAjeF6d64CNQqmmTi3LODFrFP0Nd3TPFSPu7anJbUsxiAXRi42eAZr33ma94u39p6P2GoCnFUu3_9O0q7_wY9hJJyQ Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:08.122748 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}] Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 93d86ae4501e43d59d172d2e7acfdd54 Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.124331 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '0a569a7b-878e-482c-81f8-da11268e6b1b'} Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:08.125158 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.126402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.127637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Returning 404 to user: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:08.127637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a11188e9-18ab-42ec-8a92-a5709f0ec772 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 404 len: 111 microversion: 2.1 time: 0.031779 Aug 01 15:31:08.127637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 456/935] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:31:08 2022] DELETE /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:08.133624 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:08.134181 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 0a569a7b-878e-482c-81f8-da11268e6b1b] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:08.141065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.141511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.142317 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.142743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.156769 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] HTTP exception thrown: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Request method failure captured: Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b HTTP/1.1 Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AWP30hUQfhi2C8UkMpSx3bh0fLBSt0O2p0psKO_yKogOEjhYRK_f5htYXhJ3XovQTE1U1KdFkiImC9TSL3zIAjeF6d64CNQqmmTi3LODFrFP0Nd3TPFSPu7anJbUsxiAXRi42eAZr33ma94u39p6P2GoCnFUu3_9O0q7_wY9hJJyQ Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:08.158376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}] Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 93d86ae4501e43d59d172d2e7acfdd54 Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.160112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '0a569a7b-878e-482c-81f8-da11268e6b1b'} Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:08.160997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. Aug 01 15:31:08.162550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.164180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Returning 404 to user: Instance 0a569a7b-878e-482c-81f8-da11268e6b1b could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:08.164180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d380856-d107-4c5d-bcd2-626639797242 tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b" status: 404 len: 111 microversion: 2.1 time: 0.030301 Aug 01 15:31:08.164180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 480/936] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:08 2022] GET /compute/v2.1/servers/0a569a7b-878e-482c-81f8-da11268e6b1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:31:08.313763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:08.314628 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:08.320972 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.321414 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.322199 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.322624 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.336946 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 HTTP/1.1 Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:08.338523 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.341082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '061e74c4-3c31-46e4-af02-799b6e731274'} Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:08.342678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.345505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.348293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:08.348293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5464899f-25f2-4da8-9b79-bb2fe26f2e0a tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "DELETE /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 404 len: 111 microversion: 2.1 time: 0.030171 Aug 01 15:31:08.348293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 457/937] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:31:08 2022] DELETE /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:08.352515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:08.353130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] [instance: 061e74c4-3c31-46e4-af02-799b6e731274] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:08.359529 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.360096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.360912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.361347 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.378038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] HTTP exception thrown: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Request method failure captured: Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 HTTP/1.1 Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AS4Ev9v-5q25zIf8hAGeXhGfjmlJCYO-19sTxSn3OC2xIjQ84QB1AYeOh4kUcuzheH08f-_7WkHsTn1HxyD2bk9DUP8--K-WksTOi6PkvW2SHDVALAFbk7DQ3LSxTWO2QMt7Zivz4KwFJJGhmQqWFkdaGrpKD32if-ODJzLd0fais Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:08.379689 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d47732c77c34b63a94b3f682f420416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d47732c77c34b63a94b3f682f420416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d47732c77c34b63a94b3f682f420416"}]}] Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d47732c77c34b63a94b3f682f420416 Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1599674853 Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: d79f95d9699b4b0393e14a9212986ad5 Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1599674853-project Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.381411 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '061e74c4-3c31-46e4-af02-799b6e731274'} Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:08.386101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. Aug 01 15:31:08.388155 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:08.390026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] Returning 404 to user: Instance 061e74c4-3c31-46e4-af02-799b6e731274 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:08.390026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d230d9f-c324-43b7-92c4-d68979a0cb36 tempest-AttachVolumeNegativeTest-1599674853 tempest-AttachVolumeNegativeTest-1599674853-project] 10.222.0.48 "GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274" status: 404 len: 111 microversion: 2.1 time: 0.034354 Aug 01 15:31:08.390026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 481/938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:08 2022] GET /compute/v2.1/servers/061e74c4-3c31-46e4-af02-799b6e731274 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:08.572395 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:08.573001 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:08.579802 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.580355 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.581125 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:08.581559 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:08.720708 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:08.729234 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-50e5be06-1623-4ec0-9d97-5b5292611c64 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.160836 Aug 01 15:31:08.729827 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 458/939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:08 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:09.318465 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:09.319719 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:09.326565 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:09.327068 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:09.327852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:09.328284 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:09.343892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] HTTP exception thrown: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Request method failure captured: Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 HTTP/1.1 Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AWP30hUQfhi2C8UkMpSx3bh0fLBSt0O2p0psKO_yKogOEjhYRK_f5htYXhJ3XovQTE1U1KdFkiImC9TSL3zIAjeF6d64CNQqmmTi3LODFrFP0Nd3TPFSPu7anJbUsxiAXRi42eAZr33ma94u39p6P2GoCnFUu3_9O0q7_wY9hJJyQ Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:09.345359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}] Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 93d86ae4501e43d59d172d2e7acfdd54 Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.346759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '762918ff-4812-4e05-be65-d3ab81a9ec32'} Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:09.347554 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.348816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.350074 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Returning 404 to user: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:09.350074 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4605565a-1374-4e12-888e-efa2eba84d5c tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "DELETE /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 404 len: 111 microversion: 2.1 time: 0.032307 Aug 01 15:31:09.350074 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 482/940] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:31:09 2022] DELETE /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:09.355655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:09.356278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] [instance: 762918ff-4812-4e05-be65-d3ab81a9ec32] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:09.362972 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:09.363404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:09.364156 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:09.364578 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:09.379212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] HTTP exception thrown: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Request method failure captured: Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 HTTP/1.1 Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AWP30hUQfhi2C8UkMpSx3bh0fLBSt0O2p0psKO_yKogOEjhYRK_f5htYXhJ3XovQTE1U1KdFkiImC9TSL3zIAjeF6d64CNQqmmTi3LODFrFP0Nd3TPFSPu7anJbUsxiAXRi42eAZr33ma94u39p6P2GoCnFUu3_9O0q7_wY9hJJyQ Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:09.380890 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3b8e7cb5fc4a4e598d27e51122265bda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3b8e7cb5fc4a4e598d27e51122265bda"}]}] Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 3b8e7cb5fc4a4e598d27e51122265bda Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2118218222 Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 93d86ae4501e43d59d172d2e7acfdd54 Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeTestJSON-2118218222-project Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.382338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '762918ff-4812-4e05-be65-d3ab81a9ec32'} Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:09.383293 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. Aug 01 15:31:09.385076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:09.387806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] Returning 404 to user: Instance 762918ff-4812-4e05-be65-d3ab81a9ec32 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:09.387806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-63644af3-a1a7-41b8-a956-c803d52817db tempest-AttachVolumeTestJSON-2118218222 tempest-AttachVolumeTestJSON-2118218222-project] 10.222.0.48 "GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32" status: 404 len: 111 microversion: 2.1 time: 0.030848 Aug 01 15:31:09.387806 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 459/941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:09 2022] GET /compute/v2.1/servers/762918ff-4812-4e05-be65-d3ab81a9ec32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:09.753301 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:09.754050 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:09.761183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:09.762271 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:09.763362 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:09.763972 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:10.092879 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:10.117170 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8204192d-aa6e-4cc7-80a3-5b9e5b1d2277 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.368571 Aug 01 15:31:10.130457 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 483/942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:09 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:11.144835 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:11.149761 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:11.178530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:11.179265 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:11.180495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:11.181151 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:11.744186 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:11.755462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-08a1ab56-48c1-4522-be73-a98dd1a6b733 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.618545 Aug 01 15:31:11.771800 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 460/943] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:11 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:12.654191 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-1928a825-25a7-4263-af99-a538dcaa7ff7 req-71de8654-523a-4f8f-b536-b81a0a76e32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ec3f25-9dbe-422a-ae74-6376025a9922", "name": "network-vif-plugged", "status": "completed", "tag": "5b272150-0452-4c62-823d-5973ee6a68f8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:12.681538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1928a825-25a7-4263-af99-a538dcaa7ff7 req-71de8654-523a-4f8f-b536-b81a0a76e32a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:12.682097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-1928a825-25a7-4263-af99-a538dcaa7ff7 req-71de8654-523a-4f8f-b536-b81a0a76e32a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:12.713038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-1928a825-25a7-4263-af99-a538dcaa7ff7 req-71de8654-523a-4f8f-b536-b81a0a76e32a service nova] Creating event network-vif-plugged:5b272150-0452-4c62-823d-5973ee6a68f8 for instance 14ec3f25-9dbe-422a-ae74-6376025a9922 on hv-cinder-84713 Aug 01 15:31:12.729741 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-1928a825-25a7-4263-af99-a538dcaa7ff7 req-71de8654-523a-4f8f-b536-b81a0a76e32a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076984 Aug 01 15:31:12.738744 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 484/944] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:12.782564 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:12.783764 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:12.794290 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:12.794740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:12.795530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:12.795957 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:13.262753 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:13.277453 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-581a2708-8986-4259-82f8-94ad410029bb tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.501330 Aug 01 15:31:13.302502 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 461/945] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:12 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:14.310254 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:14.310803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:14.318277 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:14.319630 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:14.320902 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:14.321932 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:14.359509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d0dbf7fa-c7b5-42c0-bfc3-8ef51ef582c9 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Action: 'create', calling method: .version_select at 0x7f03674904c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-476961405"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:14.485769 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:14.494387 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-83b8442b-c4a6-4cb0-bf97-136b56d38d1d tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1574 microversion: 2.1 time: 0.189603 Aug 01 15:31:14.495278 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 462/946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:14 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:14.811235 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d0dbf7fa-c7b5-42c0-bfc3-8ef51ef582c9 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.604571 Aug 01 15:31:14.811871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 485/947] 10.222.0.48 () {60 vars in 1155 bytes} [Mon Aug 1 15:31:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 606 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 15:31:14.828277 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d00f4898-e059-4287-bfc9-bf1dd7f47441 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03672f68b0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:14.888345 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d00f4898-e059-4287-bfc9-bf1dd7f47441 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa" status: 200 len: 344 microversion: 2.1 time: 0.065400 Aug 01 15:31:14.889041 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 463/948] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:14 2022] GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:15.517310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:15.517926 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:15.525547 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:15.526020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:15.526823 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:15.527239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:15.681816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:15.689406 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2fe00c99-d7f9-47ea-8389-6bb18557b254 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1561 microversion: 2.1 time: 0.176760 Aug 01 15:31:15.690315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 486/949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:15 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:15.903871 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97b878d2-52a4-4c9e-8460-0476db45f301 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f0367490ca0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:15.905442 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5559e099-1360-4343-9e62-9f9263396adb tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Action: 'create', calling method: .version_select at 0x7f0367594dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-445967156", "metadata": {"Type": "work"}}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:15.957881 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97b878d2-52a4-4c9e-8460-0476db45f301 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa" status: 200 len: 345 microversion: 2.1 time: 0.058563 Aug 01 15:31:15.958569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 487/950] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:15 2022] GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:15.971168 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32f0a868-c8e8-4d2a-addf-fa61157b37e7 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Action: 'create', calling method: .version_select at 0x7f03672e1ee0>, body: {"snapshot": {"volume_id": "0bfe7e78-0103-4e64-bedc-c1c4c26c83aa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-92972177"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:16.163713 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-32f0a868-c8e8-4d2a-addf-fa61157b37e7 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.196447 Aug 01 15:31:16.164440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 488/951] 10.222.0.48 () {60 vars in 1162 bytes} [Mon Aug 1 15:31:15 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:16.177296 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38951626-ca4a-4ed6-9b05-01d3c65ecdde tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f0367554ee0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:16.219897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38951626-ca4a-4ed6-9b05-01d3c65ecdde tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 285 microversion: 2.1 time: 0.047612 Aug 01 15:31:16.220507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 489/952] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:16 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 285 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:16.231975 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bdffd756-bbcb-42aa-9c38-9806cad28f3e tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03673edb80>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:16.268852 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5559e099-1360-4343-9e62-9f9263396adb tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.497683 Aug 01 15:31:16.269832 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 464/953] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 15:31:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 499 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 15:31:16.271033 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bdffd756-bbcb-42aa-9c38-9806cad28f3e tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.042513 Aug 01 15:31:16.274983 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 490/954] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 1 15:31:16 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:16.282787 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff13264c-2425-4f02-a333-3eb2f2955024 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f0367490790>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:16.282908 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-67f07c86-e37e-4940-93b4-eb2811a3d9cc tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f0367594160>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:16.316528 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff13264c-2425-4f02-a333-3eb2f2955024 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 285 microversion: 2.1 time: 0.037738 Aug 01 15:31:16.317090 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 491/955] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:16 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:16.341900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-67f07c86-e37e-4940-93b4-eb2811a3d9cc tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 352 microversion: 2.1 time: 0.063136 Aug 01 15:31:16.342466 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 465/956] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:16 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:17.339650 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-03d4a24d-55f1-46f8-bc09-4139dda6151c tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f0367554700>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:17.364506 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-41d9c0cb-4cf2-42d7-ab12-94637c2390ff tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f03672f6160>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:17.393118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-03d4a24d-55f1-46f8-bc09-4139dda6151c tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 285 microversion: 2.1 time: 0.065322 Aug 01 15:31:17.395013 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 492/957] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:17 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 285 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:17.429645 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-41d9c0cb-4cf2-42d7-ab12-94637c2390ff tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 352 microversion: 2.1 time: 0.076180 Aug 01 15:31:17.430253 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 466/958] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:17 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:18.406426 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f35839ce-0678-4bc9-9794-416fa5c965d8 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03672e1b80>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:18.438168 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f35839ce-0678-4bc9-9794-416fa5c965d8 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 285 microversion: 2.1 time: 0.036118 Aug 01 15:31:18.443083 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 493/959] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:18 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:18.444672 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8581f27f-13b2-43c7-87be-e81c61c3c6d2 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f036c05c940>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:18.499311 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8581f27f-13b2-43c7-87be-e81c61c3c6d2 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 352 microversion: 2.1 time: 0.058987 Aug 01 15:31:18.499881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 467/960] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:18 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:19.451774 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d4fcd27-9901-46e8-8571-6a7dffe5c004 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03673edf70>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:19.482792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d4fcd27-9901-46e8-8571-6a7dffe5c004 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 286 microversion: 2.1 time: 0.035445 Aug 01 15:31:19.483369 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 494/961] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:19 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:19.501306 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-08962ae4-81b4-4243-a412-f2fc59e96220 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03672f6160>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:19.513318 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0a1358af-a3ff-48c2-af3f-ae2e3627866f tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f0367554430>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:19.565216 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0a1358af-a3ff-48c2-af3f-ae2e3627866f tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 352 microversion: 2.1 time: 0.055796 Aug 01 15:31:19.566009 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 495/962] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:19 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:19.568710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-08962ae4-81b4-4243-a412-f2fc59e96220 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 202 len: 0 microversion: 2.1 time: 0.071492 Aug 01 15:31:19.569552 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 468/963] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Aug 1 15:31:19 2022] DELETE /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:31:19.578377 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97891b31-5b1c-4549-a412-4c32184f1093 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03675514c0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:19.608721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97891b31-5b1c-4549-a412-4c32184f1093 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 285 microversion: 2.1 time: 0.034158 Aug 01 15:31:19.609295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 496/964] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:19 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:20.582260 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64127fe8-94c7-4e09-a933-d47303997c42 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f0367594700>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:20.622357 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6102d6b-5b33-4e9b-a983-577777007881 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f0367490280>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:20.634783 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-64127fe8-94c7-4e09-a933-d47303997c42 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 352 microversion: 2.1 time: 0.058286 Aug 01 15:31:20.635366 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 469/965] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:20 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:20.653402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b6102d6b-5b33-4e9b-a983-577777007881 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 285 microversion: 2.1 time: 0.035721 Aug 01 15:31:20.653993 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 497/966] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:20 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:21.653663 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d88c1c0e-2289-4047-9e4d-3bff30c62932 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f03675fd3a0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:21.667326 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3cf1fe4-b5e6-45b2-b424-901f1eeb2bee tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03675a4670>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:21.702153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3cf1fe4-b5e6-45b2-b424-901f1eeb2bee tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 200 len: 285 microversion: 2.1 time: 0.039142 Aug 01 15:31:21.702811 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 498/967] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:21 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:21.706698 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d88c1c0e-2289-4047-9e4d-3bff30c62932 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 352 microversion: 2.1 time: 0.060468 Aug 01 15:31:21.711046 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 470/968] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:21 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:22.717264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13de4cd4-0f9f-45e7-9233-07e889e56f04 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03672e1b80>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:22.727373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27764e4d-d6b7-4c3d-89db-b21f09d417fe tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f0367594c10>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:22.751047 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-13de4cd4-0f9f-45e7-9233-07e889e56f04 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] HTTP exception thrown: Snapshot bb593e08-52b5-4023-ad24-7addb0dd29d6 could not be found. Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13de4cd4-0f9f-45e7-9233-07e889e56f04 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Request method failure captured: Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 HTTP/1.1 Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_HCnn2Pa-prxaMqXsReMBLWoK_1CTgUZk2qhR3yOkqn4k-yLyh5M4YlEzPTYrC7GVAR9jkKQqOk-vfdBfiL9OrqKeagVJ8rM_jrAML4D7BA4uCnHpGFAfGzRTnad7eTXqohVKTCk-G45dCt7-0WaZKxpDKoFYomy4TUHm8kQQTQRrY Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:22.754544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}] Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: cb2c553070cf423cb8e25657c8f5c648 Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Snapshot bb593e08-52b5-4023-ad24-7addb0dd29d6 could not be found. Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'bb593e08-52b5-4023-ad24-7addb0dd29d6'} Aug 01 15:31:22.755944 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bb593e08-52b5-4023-ad24-7addb0dd29d6 could not be found. (HTTP 404) (Request-ID: req-db2345de-e61c-4e50-8e5f-7c33054c8cb6) Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:22.757410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:22.759538 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bb593e08-52b5-4023-ad24-7addb0dd29d6 could not be found. Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 15:31:22.761224 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bb593e08-52b5-4023-ad24-7addb0dd29d6 could not be found. Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bb593e08-52b5-4023-ad24-7addb0dd29d6 could not be found. Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13de4cd4-0f9f-45e7-9233-07e889e56f04 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Returning 404 to user: Snapshot bb593e08-52b5-4023-ad24-7addb0dd29d6 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:22.762707 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13de4cd4-0f9f-45e7-9233-07e889e56f04 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6" status: 404 len: 111 microversion: 2.1 time: 0.043302 Aug 01 15:31:22.763860 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 499/969] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 15:31:22 2022] GET /compute/v2.1/os-snapshots/bb593e08-52b5-4023-ad24-7addb0dd29d6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:22.767195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6bd8b8dd-4318-47cf-966d-1ba0183c5161 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03675aba60>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:22.781215 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27764e4d-d6b7-4c3d-89db-b21f09d417fe tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 353 microversion: 2.1 time: 0.064531 Aug 01 15:31:22.781924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 471/970] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:22 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:22.794935 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-18c3f287-1f57-4e85-b926-0fe9a9b5669b tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f03672f6f70>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:22.848302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-18c3f287-1f57-4e85-b926-0fe9a9b5669b tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 353 microversion: 2.1 time: 0.057346 Aug 01 15:31:22.848885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 472/971] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:22 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:22.866886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6bd8b8dd-4318-47cf-966d-1ba0183c5161 tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa" status: 202 len: 0 microversion: 2.1 time: 0.102486 Aug 01 15:31:22.867495 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d17a76c3-931a-4d8a-82f7-3dd644d9bfb6 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f036c05c790>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:22.868258 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 500/972] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:31:22 2022] DELETE /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:31:22.879251 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96af098b-48c5-4b37-a85e-0f06ff146f2d tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03672e1790>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:22.940857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96af098b-48c5-4b37-a85e-0f06ff146f2d tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa" status: 200 len: 344 microversion: 2.1 time: 0.067525 Aug 01 15:31:22.941669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 501/973] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:22 2022] GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:31:22.954965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d17a76c3-931a-4d8a-82f7-3dd644d9bfb6 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 202 len: 0 microversion: 2.1 time: 0.091948 Aug 01 15:31:22.955579 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 473/974] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:31:22 2022] DELETE /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:31:22.964115 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d7a239cd-6690-4480-8d30-13907219bbd5 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f03675abee0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:23.014904 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d7a239cd-6690-4480-8d30-13907219bbd5 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 200 len: 352 microversion: 2.1 time: 0.054785 Aug 01 15:31:23.015504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 502/975] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:22 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:23.958354 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d17b0094-afda-4206-81c0-267907205cdf tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f0367733820>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:23.991086 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-d17b0094-afda-4206-81c0-267907205cdf tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] HTTP exception thrown: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d17b0094-afda-4206-81c0-267907205cdf tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Request method failure captured: Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa HTTP/1.1 Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_HCnn2Pa-prxaMqXsReMBLWoK_1CTgUZk2qhR3yOkqn4k-yLyh5M4YlEzPTYrC7GVAR9jkKQqOk-vfdBfiL9OrqKeagVJ8rM_jrAML4D7BA4uCnHpGFAfGzRTnad7eTXqohVKTCk-G45dCt7-0WaZKxpDKoFYomy4TUHm8kQQTQRrY Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:23.994296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}] Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: cb2c553070cf423cb8e25657c8f5c648 Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '0bfe7e78-0103-4e64-bedc-c1c4c26c83aa'} Aug 01 15:31:23.996218 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. (HTTP 404) (Request-ID: req-c7912fd2-0753-4309-8986-2f082ca820eb) Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:23.997613 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:23.999655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:31:24.001541 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d17b0094-afda-4206-81c0-267907205cdf tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Returning 404 to user: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d17b0094-afda-4206-81c0-267907205cdf tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa" status: 404 len: 109 microversion: 2.1 time: 0.043178 Aug 01 15:31:24.004192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 474/976] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:23 2022] GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:24.021559 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1cce3ac3-fbdd-433c-867c-0e6bf887c40b tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03675b3940>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:24.034062 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64270b08-ee3b-4868-ae5e-79d0e7fa8948 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Calling method '.version_select at 0x7f036733ce50>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:24.055797 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1cce3ac3-fbdd-433c-867c-0e6bf887c40b tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] HTTP exception thrown: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1cce3ac3-fbdd-433c-867c-0e6bf887c40b tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Request method failure captured: Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa HTTP/1.1 Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_HCnn2Pa-prxaMqXsReMBLWoK_1CTgUZk2qhR3yOkqn4k-yLyh5M4YlEzPTYrC7GVAR9jkKQqOk-vfdBfiL9OrqKeagVJ8rM_jrAML4D7BA4uCnHpGFAfGzRTnad7eTXqohVKTCk-G45dCt7-0WaZKxpDKoFYomy4TUHm8kQQTQRrY Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:24.058173 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}] Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: cb2c553070cf423cb8e25657c8f5c648 Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '0bfe7e78-0103-4e64-bedc-c1c4c26c83aa'} Aug 01 15:31:24.060998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. (HTTP 404) (Request-ID: req-6edac5c8-5bca-42fe-97b7-130eff63b846) Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.062530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:31:24.064898 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:31:24.067569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1cce3ac3-fbdd-433c-867c-0e6bf887c40b tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Returning 404 to user: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1cce3ac3-fbdd-433c-867c-0e6bf887c40b tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa" status: 404 len: 109 microversion: 2.1 time: 0.048803 Aug 01 15:31:24.070000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 503/977] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:31:24 2022] DELETE /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:24.074070 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-64270b08-ee3b-4868-ae5e-79d0e7fa8948 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] HTTP exception thrown: Volume a25c6887-a655-4cce-8892-94eed7ef582d could not be found. Aug 01 15:31:24.074997 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cbc79796-5338-4fdc-89a1-8eb85e920fff tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Calling method '.version_select at 0x7f03672e1280>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64270b08-ee3b-4868-ae5e-79d0e7fa8948 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Request method failure captured: Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d HTTP/1.1 Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_HDAyv87OZpWvvvVH0o0RC9XOtOdvFn92DP21FAwh2g8c-TAe2PLtZT_rUkgNq02GDb1DHReT15CBz_Wvy587fXwfuNxNmgMN4QRNQjnjt87rwAroIYvxn7RfJT1-MM60DDK0vUJu3NrMcPsW--dCmJURTBKx3oSGZwkmuM7LBH4YM Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: f1aea5fac11c44718d8fea0c6ede45c0 Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesGetTestJSON-268589816 Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:24.076269 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1aea5fac11c44718d8fea0c6ede45c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f1aea5fac11c44718d8fea0c6ede45c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f1aea5fac11c44718d8fea0c6ede45c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1aea5fac11c44718d8fea0c6ede45c0"}]}] Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesGetTestJSON-268589816 Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: f1aea5fac11c44718d8fea0c6ede45c0 Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesGetTestJSON-268589816 Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesGetTestJSON-268589816-project Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 9a55b56f77674ac18e919d262f1bd4dd Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesGetTestJSON-268589816-project Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Volume a25c6887-a655-4cce-8892-94eed7ef582d could not be found. Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'a25c6887-a655-4cce-8892-94eed7ef582d'} Aug 01 15:31:24.079653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a25c6887-a655-4cce-8892-94eed7ef582d could not be found. (HTTP 404) (Request-ID: req-72ef2e50-f3a5-4045-bd3c-eb083f7f3107) Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.082144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:24.086024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a25c6887-a655-4cce-8892-94eed7ef582d could not be found. Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:31:24.091093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a25c6887-a655-4cce-8892-94eed7ef582d could not be found. Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a25c6887-a655-4cce-8892-94eed7ef582d could not be found. Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-64270b08-ee3b-4868-ae5e-79d0e7fa8948 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] Returning 404 to user: Volume a25c6887-a655-4cce-8892-94eed7ef582d could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-64270b08-ee3b-4868-ae5e-79d0e7fa8948 tempest-VolumesGetTestJSON-268589816 tempest-VolumesGetTestJSON-268589816-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d" status: 404 len: 109 microversion: 2.1 time: 0.051471 Aug 01 15:31:24.092300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 475/978] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:24 2022] GET /compute/v2.1/os-volumes/a25c6887-a655-4cce-8892-94eed7ef582d => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:24.127331 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-cbc79796-5338-4fdc-89a1-8eb85e920fff tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] HTTP exception thrown: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cbc79796-5338-4fdc-89a1-8eb85e920fff tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Request method failure captured: Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa HTTP/1.1 Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_HCnn2Pa-prxaMqXsReMBLWoK_1CTgUZk2qhR3yOkqn4k-yLyh5M4YlEzPTYrC7GVAR9jkKQqOk-vfdBfiL9OrqKeagVJ8rM_jrAML4D7BA4uCnHpGFAfGzRTnad7eTXqohVKTCk-G45dCt7-0WaZKxpDKoFYomy4TUHm8kQQTQRrY Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:24.129520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db8d0287e25f4873ba51a184f4748a41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db8d0287e25f4873ba51a184f4748a41"}]}] Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: db8d0287e25f4873ba51a184f4748a41 Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257751041 Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: cb2c553070cf423cb8e25657c8f5c648 Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257751041-project Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '0bfe7e78-0103-4e64-bedc-c1c4c26c83aa'} Aug 01 15:31:24.131783 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. (HTTP 404) (Request-ID: req-92c6bd22-b9f6-44c8-b2bb-9387bb9e7ad3) Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.133537 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:24.135816 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:31:24.138069 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cbc79796-5338-4fdc-89a1-8eb85e920fff tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] Returning 404 to user: Volume 0bfe7e78-0103-4e64-bedc-c1c4c26c83aa could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cbc79796-5338-4fdc-89a1-8eb85e920fff tempest-VolumesSnapshotsTestJSON-1257751041 tempest-VolumesSnapshotsTestJSON-1257751041-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa" status: 404 len: 109 microversion: 2.1 time: 0.061567 Aug 01 15:31:24.140379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 504/979] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:24 2022] GET /compute/v2.1/os-volumes/0bfe7e78-0103-4e64-bedc-c1c4c26c83aa => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:27.056210 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:27.057018 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:27.067360 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1019334610", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2087018318", "security_groups": [{"name": "tempest-secgroup-smoke-2024196989"}], "block_device_mapping_v2": [{"uuid": "24df0019-5b83-459e-b1d8-a0802a1b66be", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cde6e32b-9ffe-4036-ade9-45f54f08a2da"}]}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:27.200488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.network.neutron [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] validate_networks() for [('cde6e32b-9ffe-4036-ade9-45f54f08a2da', None, None, None, None, None)] {{(pid=117824) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:31:27.794803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Flavor limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:31:27.795961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Image limits 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:31:27.797132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Flavor pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:31:27.797987 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Image pref 0:0:0 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:31:27.799220 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.virt.hardware [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117824) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:31:27.817629 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:27.818587 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:27.820200 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:27.821074 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:27.857326 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for project 97f413eea3b945cc843040b11d501993. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:31:27.865587 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Getting quotas for user 0898fda8be3743f093dbb216f21eb931 and project 97f413eea3b945cc843040b11d501993. Resources: {'instances', 'cores', 'ram'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:31:27.974491 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Going to run 1 instances... {{(pid=117824) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:31:27.977704 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24df0019-5b83-459e-b1d8-a0802a1b66be',volume_size=None,volume_type=None)] {{(pid=117824) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:31:28.203183 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-24dbc2df-e123-4279-afc3-0ff9da4182d9 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.147370 Aug 01 15:31:28.206014 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 476/980] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:31:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:31:28.214544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:28.215375 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=93 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:28.219911 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ba2d3c73-9bed-46da-9ccc-93d79cdb4677 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:28.221688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ba2d3c73-9bed-46da-9ccc-93d79cdb4677 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:28.341599 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ba2d3c73-9bed-46da-9ccc-93d79cdb4677 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:28.350423 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ba2d3c73-9bed-46da-9ccc-93d79cdb4677 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1095 microversion: 2.1 time: 0.137670 Aug 01 15:31:28.352829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 505/981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:28 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1095 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:31:29.390678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:29.395492 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:29.417641 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:29.420715 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:29.421951 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:29.423585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:29.547686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:29.570053 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bb6113a3-36ce-4906-a67e-7944b12ff6d5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1201 microversion: 2.1 time: 0.185557 Aug 01 15:31:29.571470 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 477/982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:29 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1201 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:30.605030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:30.608845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:30.622023 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:30.622941 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:30.624524 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:30.625426 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:31.059032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:31.076239 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc753a09-0954-4d2d-8928-50769f89a0b3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.484668 Aug 01 15:31:31.077723 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 506/983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:30 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:31.693650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-65a37c07-1784-4f12-b1fb-b14b2622780c req-387531ef-ca78-47c3-856b-f7964e6419ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af3584c-8d03-48c9-9dba-be6afd6945f7", "tag": "68396f97-50f0-4f0c-a053-c52ece647f48"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:31.706987 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-65a37c07-1784-4f12-b1fb-b14b2622780c req-387531ef-ca78-47c3-856b-f7964e6419ee service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:31.708340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-65a37c07-1784-4f12-b1fb-b14b2622780c req-387531ef-ca78-47c3-856b-f7964e6419ee service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:31.729700 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-65a37c07-1784-4f12-b1fb-b14b2622780c req-387531ef-ca78-47c3-856b-f7964e6419ee service nova] Creating event network-changed:68396f97-50f0-4f0c-a053-c52ece647f48 for instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 on hv-cinder-84713 Aug 01 15:31:31.739250 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-65a37c07-1784-4f12-b1fb-b14b2622780c req-387531ef-ca78-47c3-856b-f7964e6419ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050461 Aug 01 15:31:31.739941 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 478/984] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:32.105315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:32.106002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:32.114407 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:32.114932 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:32.117637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:32.117637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:32.309593 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:32.320982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29e3fe5f-fa00-4b51-9e8d-1b67f8563b70 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.220659 Aug 01 15:31:32.321685 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 507/985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:32 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:33.345481 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:33.346255 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:33.353137 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:33.353637 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:33.354447 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:33.354876 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:33.521373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:33.531161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b97af5bb-72c4-4b11-a76d-fbd5a214127c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.190901 Aug 01 15:31:33.531867 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 479/986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:33 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:34.564475 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:34.565605 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:34.576431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:34.577285 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:34.579213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:34.579864 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:34.929635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:34.940522 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad18b8d7-7f17-4028-8995-02302e9a57da tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.383830 Aug 01 15:31:34.941483 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 508/987] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:34 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:35.398866 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8c7eaf94-dede-492f-8ede-0913f494cf88 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:35.402609 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8c7eaf94-dede-492f-8ede-0913f494cf88 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:35.417803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c7eaf94-dede-492f-8ede-0913f494cf88 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:35.418727 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c7eaf94-dede-492f-8ede-0913f494cf88 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:35.419897 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c7eaf94-dede-492f-8ede-0913f494cf88 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:35.421045 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8c7eaf94-dede-492f-8ede-0913f494cf88 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:35.473377 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8c7eaf94-dede-492f-8ede-0913f494cf88 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083390 Aug 01 15:31:35.474434 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 480/988] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 15:31:35 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:35.600386 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:35.601256 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:35.619658 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:35.621833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:35.624902 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:35.627045 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:35.683446 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:31:35.861886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a07b8284-7c0a-405a-8135-6ae081d73597 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 204 len: 0 microversion: 2.20 time: 0.256340 Aug 01 15:31:35.869698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 509/989] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 15:31:35 2022] DELETE /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:31:35.893483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:35.897058 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:35.909464 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:35.910264 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:35.911678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:35.913817 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:35.984270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:35.985255 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:35.997466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:35.998510 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:36.000062 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:36.001874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:36.270413 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:36.286850 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:36.288509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:36.289835 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-98723c24-e86e-4648-a889-15051a329093 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.414754 Aug 01 15:31:36.290553 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 481/990] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:31:35 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:31:36.319884 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:36.333488 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4a4aac3-8b95-4341-baaa-29758324ad40 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.361786 Aug 01 15:31:36.335593 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 510/991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:35 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:37.323486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:37.324261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:37.333228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.334031 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:37.335039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.335535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:37.373010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:37.374177 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:37.385713 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.386612 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:37.388401 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:37.389109 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:37.649468 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:37.664203 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:37.668192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:37.669962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:37.671332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b5c0b9ac-089d-4837-b44f-c5100b18d0f1 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1723 microversion: 2.20 time: 0.354154 Aug 01 15:31:37.672047 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 482/992] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:31:37 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:31:37.679357 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e04bf2a4-00d4-489d-a093-5523760a7e8f tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.312709 Aug 01 15:31:37.689830 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 511/993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:37 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:31:38.712406 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:38.713352 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:38.716624 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:38.721692 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:38.722684 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:38.731365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:38.736345 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:38.736785 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:38.737561 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:38.738032 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:38.742678 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:31:38.744873 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:38.745315 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:38.746132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:38.746549 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:38.941836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:38.956093 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:38.958347 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c60ee64ca18e4930a14e3e17bc979ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5400c4df102f43398a278247c4431ef6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:38.960134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-2cb123d9-6214-4414-81a6-18e025868473 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 200 len: 1656 microversion: 2.20 time: 0.263826 Aug 01 15:31:38.961102 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 483/994] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:31:38 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 1656 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:31:39.189487 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:39.202938 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31a7a812-e130-4c65-af09-55a59bbc0df1 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.494167 Aug 01 15:31:39.204843 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 512/995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:38 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:39.398426 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-6faab1b5-46be-4929-bb14-75c7fa379a4d req-afa84df9-261d-4586-b337-8836ea9cbd7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c295d39-1434-4597-a68a-a46cea5899f9", "name": "network-vif-deleted", "tag": "e0b42de4-84fd-4819-a551-2256b22587ca"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:39.416997 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6faab1b5-46be-4929-bb14-75c7fa379a4d req-afa84df9-261d-4586-b337-8836ea9cbd7a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:39.417728 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-6faab1b5-46be-4929-bb14-75c7fa379a4d req-afa84df9-261d-4586-b337-8836ea9cbd7a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:39.452020 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-6faab1b5-46be-4929-bb14-75c7fa379a4d req-afa84df9-261d-4586-b337-8836ea9cbd7a service nova] Creating event network-vif-deleted:e0b42de4-84fd-4819-a551-2256b22587ca for instance 1c295d39-1434-4597-a68a-a46cea5899f9 on hv-cinder-84713 Aug 01 15:31:39.464104 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-6faab1b5-46be-4929-bb14-75c7fa379a4d req-afa84df9-261d-4586-b337-8836ea9cbd7a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075303 Aug 01 15:31:39.469574 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 484/996] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:39.985977 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:39.987847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:39.997259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:39.997714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:39.998912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:39.999364 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:40.015487 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] HTTP exception thrown: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Request method failure captured: Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 HTTP/1.1 Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AOLKgLDJ-pxz0u8H8vyrO8CBE9I7Qpk7eFdim0YXde0ivlp2qkXfFV4SbkJl4k0Hycxe0WdAKvXfenAvC6hR6teih0EaKbio7tFgQ5F5J64eHXPNODMeHnKIMPX9AdQfKWHW2rsRC9ynXy2-L8eCAn_tC_S28gNTDrobw6vryDxhU Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:40.017722 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5400c4df102f43398a278247c4431ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5400c4df102f43398a278247c4431ef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}] Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: c60ee64ca18e4930a14e3e17bc979ff7 Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:40.019502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '1c295d39-1434-4597-a68a-a46cea5899f9'} Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:40.020432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:40.025946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:40.027145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Returning 404 to user: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:40.027145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0aad4975-645f-4174-86e3-6e82a0d3c137 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 404 len: 111 microversion: 2.20 time: 0.038654 Aug 01 15:31:40.027145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 513/997] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:31:39 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:31:40.037371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a5f0385-1f71-42aa-93b1-440bfa11d620 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '.version_select at 0x7f03675094c0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:40.077494 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a5f0385-1f71-42aa-93b1-440bfa11d620 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-593963452" status: 204 len: 0 microversion: 2.20 time: 0.045944 Aug 01 15:31:40.079530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 485/998] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Aug 1 15:31:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-593963452 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:31:40.230892 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:40.232959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:40.245137 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:40.246396 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:40.250750 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:40.252042 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:40.501205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:40.511282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8f83fa5b-6a20-430b-9484-60c3b730f709 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.287698 Aug 01 15:31:40.521938 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 514/999] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:40 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:41.538468 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:41.540135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:41.554505 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:41.555528 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:41.556427 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:41.557088 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:41.782538 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:41.805386 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8a070a03-1bfc-467d-9878-ca3b6aaeb892 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.274688 Aug 01 15:31:41.806408 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 486/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:41 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:42.455888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:42.456726 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:42.467389 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:42.468102 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:42.469400 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:42.470105 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:42.490591 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] HTTP exception thrown: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Request method failure captured: Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 HTTP/1.1 Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AOLKgLDJ-pxz0u8H8vyrO8CBE9I7Qpk7eFdim0YXde0ivlp2qkXfFV4SbkJl4k0Hycxe0WdAKvXfenAvC6hR6teih0EaKbio7tFgQ5F5J64eHXPNODMeHnKIMPX9AdQfKWHW2rsRC9ynXy2-L8eCAn_tC_S28gNTDrobw6vryDxhU Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:42.492530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5400c4df102f43398a278247c4431ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5400c4df102f43398a278247c4431ef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}] Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: c60ee64ca18e4930a14e3e17bc979ff7 Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.495519 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '1c295d39-1434-4597-a68a-a46cea5899f9'} Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:42.496935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.499397 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.504310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Returning 404 to user: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:42.504310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd73bd49-acb5-41a0-a825-714bc0907a9e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 404 len: 111 microversion: 2.20 time: 0.047612 Aug 01 15:31:42.504310 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 515/1001] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 15:31:42 2022] DELETE /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:31:42.507738 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:42.508587 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 1c295d39-1434-4597-a68a-a46cea5899f9] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:42.519598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:42.520465 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:42.522300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:42.523083 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:42.539343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] HTTP exception thrown: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Request method failure captured: Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 HTTP/1.1 Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AOLKgLDJ-pxz0u8H8vyrO8CBE9I7Qpk7eFdim0YXde0ivlp2qkXfFV4SbkJl4k0Hycxe0WdAKvXfenAvC6hR6teih0EaKbio7tFgQ5F5J64eHXPNODMeHnKIMPX9AdQfKWHW2rsRC9ynXy2-L8eCAn_tC_S28gNTDrobw6vryDxhU Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:42.541013 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5400c4df102f43398a278247c4431ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5400c4df102f43398a278247c4431ef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}] Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: c60ee64ca18e4930a14e3e17bc979ff7 Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.543809 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '1c295d39-1434-4597-a68a-a46cea5899f9'} Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:42.544722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. Aug 01 15:31:42.546205 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:42.548163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Returning 404 to user: Instance 1c295d39-1434-4597-a68a-a46cea5899f9 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:42.548163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4f75fecd-9f86-4ee5-9238-922b3741068a tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9" status: 404 len: 111 microversion: 2.20 time: 0.040321 Aug 01 15:31:42.548163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 487/1002] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:31:42 2022] GET /compute/v2.1/servers/1c295d39-1434-4597-a68a-a46cea5899f9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:31:42.830157 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:42.830773 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:42.843902 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:42.844653 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:42.846194 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:42.846849 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:43.079910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:43.089992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-97c371e1-b285-4bd4-b9c7-7e0fdf179c9a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.264040 Aug 01 15:31:43.090678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 516/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:42 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:43.759815 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:43.760710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:43.773608 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:43.774457 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:43.776346 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:43.777402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:43.803307 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] HTTP exception thrown: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Request method failure captured: Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f HTTP/1.1 Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_AOLKgLDJ-pxz0u8H8vyrO8CBE9I7Qpk7eFdim0YXde0ivlp2qkXfFV4SbkJl4k0Hycxe0WdAKvXfenAvC6hR6teih0EaKbio7tFgQ5F5J64eHXPNODMeHnKIMPX9AdQfKWHW2rsRC9ynXy2-L8eCAn_tC_S28gNTDrobw6vryDxhU Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:43.805566 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5400c4df102f43398a278247c4431ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5400c4df102f43398a278247c4431ef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}] Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: c60ee64ca18e4930a14e3e17bc979ff7 Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.807962 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '7b57efc3-5810-4f01-9863-c16ab9dba00f'} Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:43.808740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.810237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.811478 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Returning 404 to user: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:43.811478 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d4d3dccb-85d0-4df7-8b73-199d33460c6e tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 404 len: 111 microversion: 2.20 time: 0.055813 Aug 01 15:31:43.811478 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 488/1004] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 15:31:43 2022] DELETE /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:31:43.818324 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:43.819187 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] [instance: 7b57efc3-5810-4f01-9863-c16ab9dba00f] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:43.826863 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:43.827362 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:43.828141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:43.828937 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:43.844125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] HTTP exception thrown: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Request method failure captured: Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f HTTP/1.1 Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_AOLKgLDJ-pxz0u8H8vyrO8CBE9I7Qpk7eFdim0YXde0ivlp2qkXfFV4SbkJl4k0Hycxe0WdAKvXfenAvC6hR6teih0EaKbio7tFgQ5F5J64eHXPNODMeHnKIMPX9AdQfKWHW2rsRC9ynXy2-L8eCAn_tC_S28gNTDrobw6vryDxhU Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:43.846017 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5400c4df102f43398a278247c4431ef6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5400c4df102f43398a278247c4431ef6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5400c4df102f43398a278247c4431ef6"}]}] Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 5400c4df102f43398a278247c4431ef6 Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-627574765 Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: c60ee64ca18e4930a14e3e17bc979ff7 Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-627574765-project Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.848195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '7b57efc3-5810-4f01-9863-c16ab9dba00f'} Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:43.849183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. Aug 01 15:31:43.851771 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:43.853334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] Returning 404 to user: Instance 7b57efc3-5810-4f01-9863-c16ab9dba00f could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:43.853334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9cc2774e-bc20-4a23-98dd-3ec013ac6011 tempest-AttachVolumeShelveTestJSON-627574765 tempest-AttachVolumeShelveTestJSON-627574765-project] 10.222.0.48 "GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f" status: 404 len: 111 microversion: 2.20 time: 0.034009 Aug 01 15:31:43.853334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 517/1005] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 15:31:43 2022] GET /compute/v2.1/servers/7b57efc3-5810-4f01-9863-c16ab9dba00f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:31:44.121577 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:44.122724 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:44.134247 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:44.134766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:44.135846 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:44.137579 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:44.556887 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:44.565979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-cb9b50af-f88c-476f-ad65-6583975850d4 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.453613 Aug 01 15:31:44.574770 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 489/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:44 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:45.590838 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:45.592031 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:45.617594 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:45.618468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:45.619254 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:45.619672 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:45.989699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:46.007957 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-587e7248-a7da-4139-b2cd-30b567fd1fc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.422756 Aug 01 15:31:46.021501 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 518/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:45 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:47.028991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:47.030489 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:47.038302 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:47.039023 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:47.040188 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:47.040773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:47.216812 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:47.225261 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7c57c6e6-4a35-429a-a4a3-ffe33bb13815 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.200254 Aug 01 15:31:47.238119 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 490/1008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:47 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:47.607847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-29a0c81b-1181-4958-8cb2-00c40ce6427b req-dd4843e9-4503-425f-8b72-7df7802c3bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af3584c-8d03-48c9-9dba-be6afd6945f7", "name": "network-vif-plugged", "status": "completed", "tag": "68396f97-50f0-4f0c-a053-c52ece647f48"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:47.619343 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-29a0c81b-1181-4958-8cb2-00c40ce6427b req-dd4843e9-4503-425f-8b72-7df7802c3bf3 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:47.619984 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-29a0c81b-1181-4958-8cb2-00c40ce6427b req-dd4843e9-4503-425f-8b72-7df7802c3bf3 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:47.633013 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-29a0c81b-1181-4958-8cb2-00c40ce6427b req-dd4843e9-4503-425f-8b72-7df7802c3bf3 service nova] Creating event network-vif-plugged:68396f97-50f0-4f0c-a053-c52ece647f48 for instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 on hv-cinder-84713 Aug 01 15:31:47.638125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-29a0c81b-1181-4958-8cb2-00c40ce6427b req-dd4843e9-4503-425f-8b72-7df7802c3bf3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034680 Aug 01 15:31:47.639430 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 519/1009] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:31:48.247688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:48.248300 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:48.256023 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:48.256465 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:48.257222 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:48.263982 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:48.533156 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:48.541335 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-413f113f-da4f-420c-bed5-47bde529286d tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1267 microversion: 2.1 time: 0.297928 Aug 01 15:31:48.542184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 491/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:48 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:49.567061 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:49.568558 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:49.579561 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:49.580901 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:49.581815 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:49.582493 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:49.783631 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:49.792740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f5168fc5-01d9-415c-9fd1-a95248666ab6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1454 microversion: 2.1 time: 0.233427 Aug 01 15:31:49.793315 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 520/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:49 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1454 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:31:49.815159 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:49.815159 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:31:49.821398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:49.822127 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:49.823082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:49.823509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:50.012380 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:31:50.032887 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aec80288-ba20-45ea-96b9-642f436660de tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1454 microversion: 2.1 time: 0.223056 Aug 01 15:31:50.034412 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 492/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:31:49 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:31:50.101271 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4d938ac-cb26-4a9b-a225-5933dbda8eac tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Action: 'create', calling method: .version_select at 0x7f03673788b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1886257443", "metadata": {"Type": "work"}}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4d938ac-cb26-4a9b-a225-5933dbda8eac tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Request method failure captured: Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 122 Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_Hl3oD-ieO86PyVZmCWqH7tgqNWIkDi4SPwtuD_KBxB_7DK7GmNHSYwqVyQmSvzvbgtvwps-CaZpKWW8RsEAY9KR_3r2HbZMKiy8wwBZq5rmbKUTfoW_IR7o6vUGf8quNLdS-GYUei3yhbp7U5Uar90Bp7oTYZtjlHRg7V2zKq4Cmk Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:50.112466 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}] Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 20a34732bd8c49b19afee415ee58a1ed Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1886257443", "metadata": {"Type": "work"}}} Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: Aug 01 15:31:50.114678 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1886257443', 'metadata': {'Type': 'work'}}}} Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:50.115795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:31:50.117555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:31:50.118839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:31:50.118839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.118839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4d938ac-cb26-4a9b-a225-5933dbda8eac tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:50.118839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c4d938ac-cb26-4a9b-a225-5933dbda8eac tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.245884 Aug 01 15:31:50.118839 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 521/1013] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 15:31:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:31:50.124663 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4c37f4f-b868-4793-a9fb-6177ac7e1da4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Action: 'create', calling method: .version_select at 0x7f03675fd700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-977002693", "metadata": {"Type": "work"}}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4c37f4f-b868-4793-a9fb-6177ac7e1da4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Request method failure captured: Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 119 Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_Hl3oD-ieO86PyVZmCWqH7tgqNWIkDi4SPwtuD_KBxB_7DK7GmNHSYwqVyQmSvzvbgtvwps-CaZpKWW8RsEAY9KR_3r2HbZMKiy8wwBZq5rmbKUTfoW_IR7o6vUGf8quNLdS-GYUei3yhbp7U5Uar90Bp7oTYZtjlHRg7V2zKq4Cmk Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:50.129480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}] Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 20a34732bd8c49b19afee415ee58a1ed Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-977002693", "metadata": {"Type": "work"}}} Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: Aug 01 15:31:50.131482 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-977002693', 'metadata': {'Type': 'work'}}}} Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi '0' Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:50.132779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:31:50.134441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:31:50.135786 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:31:50.135786 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.135786 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c4c37f4f-b868-4793-a9fb-6177ac7e1da4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:50.135786 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c4c37f4f-b868-4793-a9fb-6177ac7e1da4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010590 Aug 01 15:31:50.135786 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 493/1014] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 15:31:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:31:50.141883 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4e79050-54b1-488a-901e-a94a49c763b8 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Action: 'create', calling method: .version_select at 0x7f03675dc670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-771396771", "metadata": {"Type": "work"}}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4e79050-54b1-488a-901e-a94a49c763b8 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Request method failure captured: Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 118 Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_Hl3oD-ieO86PyVZmCWqH7tgqNWIkDi4SPwtuD_KBxB_7DK7GmNHSYwqVyQmSvzvbgtvwps-CaZpKWW8RsEAY9KR_3r2HbZMKiy8wwBZq5rmbKUTfoW_IR7o6vUGf8quNLdS-GYUei3yhbp7U5Uar90Bp7oTYZtjlHRg7V2zKq4Cmk Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:50.145502 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}] Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 20a34732bd8c49b19afee415ee58a1ed Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-771396771", "metadata": {"Type": "work"}}} Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: Aug 01 15:31:50.147684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-771396771', 'metadata': {'Type': 'work'}}}} Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi '' Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:50.148759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:31:50.150489 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:31:50.151761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:31:50.151761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.151761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c4e79050-54b1-488a-901e-a94a49c763b8 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:50.151761 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c4e79050-54b1-488a-901e-a94a49c763b8 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009003 Aug 01 15:31:50.157262 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a947160-bedb-461d-a8ff-368f831b4d0e tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Calling method '.version_select at 0x7f03674fae50>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:50.162121 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 522/1015] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 15:31:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 15:31:50.190213 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-6a947160-bedb-461d-a8ff-368f831b4d0e tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] HTTP exception thrown: Volume tempest-invalid-141813503 could not be found. Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a947160-bedb-461d-a8ff-368f831b4d0e tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Request method failure captured: Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-141813503 HTTP/1.1 Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_Hl3oD-ieO86PyVZmCWqH7tgqNWIkDi4SPwtuD_KBxB_7DK7GmNHSYwqVyQmSvzvbgtvwps-CaZpKWW8RsEAY9KR_3r2HbZMKiy8wwBZq5rmbKUTfoW_IR7o6vUGf8quNLdS-GYUei3yhbp7U5Uar90Bp7oTYZtjlHRg7V2zKq4Cmk Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:50.193121 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}] Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 20a34732bd8c49b19afee415ee58a1ed Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Volume tempest-invalid-141813503 could not be found. Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'tempest-invalid-141813503'} Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:50.194775 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-141813503 could not be found. (HTTP 404) (Request-ID: req-d3199c5f-658c-4171-911d-ca5346467bfc) Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.196002 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:31:50.197537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-141813503 could not be found. Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:50.199071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-141813503 could not be found. Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-141813503 could not be found. Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6a947160-bedb-461d-a8ff-368f831b4d0e tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Returning 404 to user: Volume tempest-invalid-141813503 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:50.200638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6a947160-bedb-461d-a8ff-368f831b4d0e tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-141813503" status: 404 len: 98 microversion: 2.1 time: 0.043041 Aug 01 15:31:50.202048 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 494/1016] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Aug 1 15:31:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-141813503 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:31:50.208669 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3f0d0034-0d05-4cae-851a-04dd17362960 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005386 Aug 01 15:31:50.208876 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 523/1017] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 1 15:31:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 01 15:31:50.219484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-56d523d3-88fe-4081-b9d2-954b577fd02e tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004390 Aug 01 15:31:50.220401 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 495/1018] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Aug 1 15:31:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 15:31:50.231234 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6290f8a-2f27-4fa3-9c50-5a54104ac9c4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Calling method '.version_select at 0x7f03672dcf70>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:50.261172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-b6290f8a-2f27-4fa3-9c50-5a54104ac9c4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] HTTP exception thrown: Volume 9cc78983-7fe4-48db-80f3-5f88b20d4969 could not be found. Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6290f8a-2f27-4fa3-9c50-5a54104ac9c4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Request method failure captured: Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/os-volumes/9cc78983-7fe4-48db-80f3-5f88b20d4969 HTTP/1.1 Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_Hl3oD-ieO86PyVZmCWqH7tgqNWIkDi4SPwtuD_KBxB_7DK7GmNHSYwqVyQmSvzvbgtvwps-CaZpKWW8RsEAY9KR_3r2HbZMKiy8wwBZq5rmbKUTfoW_IR7o6vUGf8quNLdS-GYUei3yhbp7U5Uar90Bp7oTYZtjlHRg7V2zKq4Cmk Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:31:50.263190 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}] Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 20a34732bd8c49b19afee415ee58a1ed Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Volume 9cc78983-7fe4-48db-80f3-5f88b20d4969 could not be found. Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '9cc78983-7fe4-48db-80f3-5f88b20d4969'} Aug 01 15:31:50.264754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9cc78983-7fe4-48db-80f3-5f88b20d4969 could not be found. (HTTP 404) (Request-ID: req-43edc50f-e73a-40a1-b736-e6bcbbca3a1b) Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.266096 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:31:50.267649 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9cc78983-7fe4-48db-80f3-5f88b20d4969 could not be found. Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:31:50.268857 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9cc78983-7fe4-48db-80f3-5f88b20d4969 could not be found. Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9cc78983-7fe4-48db-80f3-5f88b20d4969 could not be found. Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b6290f8a-2f27-4fa3-9c50-5a54104ac9c4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Returning 404 to user: Volume 9cc78983-7fe4-48db-80f3-5f88b20d4969 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b6290f8a-2f27-4fa3-9c50-5a54104ac9c4 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/9cc78983-7fe4-48db-80f3-5f88b20d4969" status: 404 len: 109 microversion: 2.1 time: 0.038072 Aug 01 15:31:50.270165 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 524/1019] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 15:31:50 2022] DELETE /compute/v2.1/os-volumes/9cc78983-7fe4-48db-80f3-5f88b20d4969 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:31:50.278069 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c18ef6d4-7ba5-4b65-ba1f-964db1e49921 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Calling method '.version_select at 0x7f03676f8700>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:31:50.308488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-c18ef6d4-7ba5-4b65-ba1f-964db1e49921 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] HTTP exception thrown: Volume c7bf7f3c-0f28-4776-92c9-c50961259ff5 could not be found. Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c18ef6d4-7ba5-4b65-ba1f-964db1e49921 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Request method failure captured: Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/os-volumes/c7bf7f3c-0f28-4776-92c9-c50961259ff5 HTTP/1.1 Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_Hl3oD-ieO86PyVZmCWqH7tgqNWIkDi4SPwtuD_KBxB_7DK7GmNHSYwqVyQmSvzvbgtvwps-CaZpKWW8RsEAY9KR_3r2HbZMKiy8wwBZq5rmbKUTfoW_IR7o6vUGf8quNLdS-GYUei3yhbp7U5Uar90Bp7oTYZtjlHRg7V2zKq4Cmk Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:31:50.310572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9d77dd15ce9b4352ad2a9c2c3605bc18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9d77dd15ce9b4352ad2a9c2c3605bc18"}]}] Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 9d77dd15ce9b4352ad2a9c2c3605bc18 Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesNegativeTest-75110762 Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 20a34732bd8c49b19afee415ee58a1ed Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesNegativeTest-75110762-project Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Volume c7bf7f3c-0f28-4776-92c9-c50961259ff5 could not be found. Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'c7bf7f3c-0f28-4776-92c9-c50961259ff5'} Aug 01 15:31:50.312204 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7bf7f3c-0f28-4776-92c9-c50961259ff5 could not be found. (HTTP 404) (Request-ID: req-64bacea8-ca31-424c-86d6-6c4f5f448633) Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.313394 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:31:50.318214 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7bf7f3c-0f28-4776-92c9-c50961259ff5 could not be found. Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:31:50.319476 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7bf7f3c-0f28-4776-92c9-c50961259ff5 could not be found. Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7bf7f3c-0f28-4776-92c9-c50961259ff5 could not be found. Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c18ef6d4-7ba5-4b65-ba1f-964db1e49921 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] Returning 404 to user: Volume c7bf7f3c-0f28-4776-92c9-c50961259ff5 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c18ef6d4-7ba5-4b65-ba1f-964db1e49921 tempest-VolumesNegativeTest-75110762 tempest-VolumesNegativeTest-75110762-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c7bf7f3c-0f28-4776-92c9-c50961259ff5" status: 404 len: 109 microversion: 2.1 time: 0.041054 Aug 01 15:31:50.320872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 496/1020] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 15:31:50 2022] GET /compute/v2.1/os-volumes/c7bf7f3c-0f28-4776-92c9-c50961259ff5 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:31:52.173066 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-c37719d2-d50e-423d-ac38-57a5642c3973 req-a6d83bf0-2413-4ed6-a862-48d70a15751c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af3584c-8d03-48c9-9dba-be6afd6945f7", "tag": "68396f97-50f0-4f0c-a053-c52ece647f48"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:31:52.184570 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c37719d2-d50e-423d-ac38-57a5642c3973 req-a6d83bf0-2413-4ed6-a862-48d70a15751c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:31:52.185589 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c37719d2-d50e-423d-ac38-57a5642c3973 req-a6d83bf0-2413-4ed6-a862-48d70a15751c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:31:52.197543 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-c37719d2-d50e-423d-ac38-57a5642c3973 req-a6d83bf0-2413-4ed6-a862-48d70a15751c service nova] Creating event network-changed:68396f97-50f0-4f0c-a053-c52ece647f48 for instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 on hv-cinder-84713 Aug 01 15:31:52.203132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-c37719d2-d50e-423d-ac38-57a5642c3973 req-a6d83bf0-2413-4ed6-a862-48d70a15751c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034827 Aug 01 15:31:52.205591 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 525/1021] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:27.289590 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:32:27.290556 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Mon Aug 1 15:32:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:32:41.515912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:41.516940 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:41.517620 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:41.518818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:41.523010 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-672a3d48-269f-4307-83a8-c2ad0c4494ec req-463e9f13-6fe5-4e39-8599-7f94eaf11b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ec3f25-9dbe-422a-ae74-6376025a9922", "tag": "5b272150-0452-4c62-823d-5973ee6a68f8"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:41.527365 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:41.528833 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=76 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:32:41.531377 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:41.532448 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:41.533610 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:41.535636 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:41.542366 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-672a3d48-269f-4307-83a8-c2ad0c4494ec req-463e9f13-6fe5-4e39-8599-7f94eaf11b39 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:41.543154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-672a3d48-269f-4307-83a8-c2ad0c4494ec req-463e9f13-6fe5-4e39-8599-7f94eaf11b39 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:41.561020 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-672a3d48-269f-4307-83a8-c2ad0c4494ec req-463e9f13-6fe5-4e39-8599-7f94eaf11b39 service nova] Creating event network-changed:5b272150-0452-4c62-823d-5973ee6a68f8 for instance 14ec3f25-9dbe-422a-ae74-6376025a9922 on hv-cinder-84713 Aug 01 15:32:41.566515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-672a3d48-269f-4307-83a8-c2ad0c4494ec req-463e9f13-6fe5-4e39-8599-7f94eaf11b39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052705 Aug 01 15:32:41.571523 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 526/1022] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:41.590446 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:32:41.737256 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c905b9a0-aeae-4de8-9ecf-2d9314fc5d56 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "DELETE /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 204 len: 0 microversion: 2.1 time: 0.232785 Aug 01 15:32:41.752179 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:41.753288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:41.757001 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 497/1023] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:32:41 2022] DELETE /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:32:41.761874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:41.762609 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:41.764072 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:41.764813 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:41.978897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:41.988581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-265c44f7-19d0-491b-93d3-84544190e4cd tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.241504 Aug 01 15:32:41.999251 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 527/1024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:41 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:43.013928 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:43.014632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:43.024951 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:43.026500 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:43.027592 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:43.028274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:43.245916 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:43.257818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-407882ba-abdf-4a38-955a-15d2a1d20b8b tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1567 microversion: 2.1 time: 0.249435 Aug 01 15:32:43.261764 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 498/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:43 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:44.286252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:44.286916 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:44.294148 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:44.294479 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:44.295699 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:44.296130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:44.697768 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-d39ef779-0fed-4071-b08e-a7111522af2f req-56657a22-5ca3-41fa-9df5-90fa6cb7dc59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ec3f25-9dbe-422a-ae74-6376025a9922", "name": "network-vif-deleted", "tag": "5b272150-0452-4c62-823d-5973ee6a68f8"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:44.716908 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b9685e174a4523a6c36d4d0bebd5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad998384c894fe9aed6d57f7aa1110b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:44.729693 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aa97aecc-106f-4d70-aa77-8d3257c97f0c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 200 len: 1449 microversion: 2.1 time: 0.448667 Aug 01 15:32:44.733856 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 528/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:44 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 1449 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:44.734686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-d39ef779-0fed-4071-b08e-a7111522af2f req-56657a22-5ca3-41fa-9df5-90fa6cb7dc59 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:44.735128 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-d39ef779-0fed-4071-b08e-a7111522af2f req-56657a22-5ca3-41fa-9df5-90fa6cb7dc59 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:44.763821 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-d39ef779-0fed-4071-b08e-a7111522af2f req-56657a22-5ca3-41fa-9df5-90fa6cb7dc59 service nova] Creating event network-vif-deleted:5b272150-0452-4c62-823d-5973ee6a68f8 for instance 14ec3f25-9dbe-422a-ae74-6376025a9922 on hv-cinder-84713 Aug 01 15:32:44.770795 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-d39ef779-0fed-4071-b08e-a7111522af2f req-56657a22-5ca3-41fa-9df5-90fa6cb7dc59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078124 Aug 01 15:32:44.771671 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 499/1027] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:45.755601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:45.756212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] [instance: 14ec3f25-9dbe-422a-ae74-6376025a9922] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:45.767330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:45.767725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:45.768504 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:45.768923 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:45.786990 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] HTTP exception thrown: Instance 14ec3f25-9dbe-422a-ae74-6376025a9922 could not be found. Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Request method failure captured: Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 HTTP/1.1 Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_DLdrdkrHG5Qgeaw3Aa9BBotJD05VxwSlpIm6OO-HaL_khdcLvnxTXBj7KLbbg3XXGJ2CEigWtK00GJKO7zS3Vf6chosDRF5d_o417OahdkLYoJaYfbXt3NgqBVH3pjzSJUzsbLMKCEzKLEabyIqNdtZV44-ztuAH5N6IAXawVwdzc Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 4ad998384c894fe9aed6d57f7aa1110b Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestShelveInstance-1935405641 Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:32:45.788673 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ad998384c894fe9aed6d57f7aa1110b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4ad998384c894fe9aed6d57f7aa1110b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4ad998384c894fe9aed6d57f7aa1110b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ad998384c894fe9aed6d57f7aa1110b"}]}] Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestShelveInstance-1935405641 Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 4ad998384c894fe9aed6d57f7aa1110b Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestShelveInstance-1935405641 Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestShelveInstance-1935405641-project Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 30b9685e174a4523a6c36d4d0bebd5fc Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestShelveInstance-1935405641-project Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 14ec3f25-9dbe-422a-ae74-6376025a9922 could not be found. Aug 01 15:32:45.790440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '14ec3f25-9dbe-422a-ae74-6376025a9922'} Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ec3f25-9dbe-422a-ae74-6376025a9922 could not be found. Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:32:45.791338 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ec3f25-9dbe-422a-ae74-6376025a9922 could not be found. Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ec3f25-9dbe-422a-ae74-6376025a9922 could not be found. Aug 01 15:32:45.792633 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:32:45.793914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Returning 404 to user: Instance 14ec3f25-9dbe-422a-ae74-6376025a9922 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:32:45.793914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-32ef47ee-f877-4aa7-b718-122dd52bec34 tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922" status: 404 len: 111 microversion: 2.1 time: 0.038396 Aug 01 15:32:45.793914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 529/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:45 2022] GET /compute/v2.1/servers/14ec3f25-9dbe-422a-ae74-6376025a9922 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:32:46.112917 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-bad0e5de-7a94-498b-bb1f-d28316aa413c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] Calling method '.version_select at 0x7f036759a3a0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:46.153700 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-bad0e5de-7a94-498b-bb1f-d28316aa413c tempest-TestShelveInstance-1935405641 tempest-TestShelveInstance-1935405641-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1355361713" status: 202 len: 0 microversion: 2.1 time: 0.046933 Aug 01 15:32:46.154535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 500/1029] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Aug 1 15:32:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1355361713 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:32:47.925491 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1715068852", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "networks": [{"uuid": "140924ad-7b52-4113-a045-2cdbb49f30bf"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:47.992879 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] validate_networks() for [('140924ad-7b52-4113-a045-2cdbb49f30bf', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:32:48.999026 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:32:48.999646 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:32:49.000055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:32:49.000468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:32:49.000866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:32:49.042158 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:49.042899 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:49.044146 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:49.054402 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:49.102070 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Getting quotas for project 1947572d5cd646d08f4efaa2ef17e271. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:32:49.115357 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Getting quotas for user 9d3652448ec141918d94617077b9ce81 and project 1947572d5cd646d08f4efaa2ef17e271. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:32:49.152514 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:32:49.159328 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:32:49.236838 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11a33d41-51f7-4949-b486-86c4265bec26 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315656 Aug 01 15:32:49.241280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 530/1030] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:32:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:32:49.255371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e65c9688-0e45-49a2-9f94-52b4029b21d6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:49.257161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e65c9688-0e45-49a2-9f94-52b4029b21d6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:49.817169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e65c9688-0e45-49a2-9f94-52b4029b21d6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:49.834885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e65c9688-0e45-49a2-9f94-52b4029b21d6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1214 microversion: 2.1 time: 0.582491 Aug 01 15:32:49.835935 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 501/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:49 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1214 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:50.900112 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:50.907953 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:50.924668 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:50.925089 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:50.940648 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:50.941381 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:51.088983 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:51.098144 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-163123c2-993d-45f5-9c19-c615c925d1e5 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1274 microversion: 2.1 time: 0.239425 Aug 01 15:32:51.099470 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 531/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:50 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1274 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:52.121622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:52.123926 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:52.142271 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:52.143029 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:52.144686 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:52.145296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:52.561008 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:52.577182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-e9d71950-988a-4993-be72-01a1f28acfa1 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1314 microversion: 2.1 time: 0.459284 Aug 01 15:32:52.578209 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 502/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:52 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:53.248674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-c7a53b73-b9c3-4eac-a233-ec2e6260e0b3 req-2da40a54-31cb-4f37-ac13-2802f05da019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695b65de-524e-4a82-8bf9-30168c45edd5", "tag": "526f05d6-1296-44d3-9c91-fbbd7f009daf"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:32:53.273515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c7a53b73-b9c3-4eac-a233-ec2e6260e0b3 req-2da40a54-31cb-4f37-ac13-2802f05da019 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:53.274077 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c7a53b73-b9c3-4eac-a233-ec2e6260e0b3 req-2da40a54-31cb-4f37-ac13-2802f05da019 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:53.287141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-c7a53b73-b9c3-4eac-a233-ec2e6260e0b3 req-2da40a54-31cb-4f37-ac13-2802f05da019 service nova] Creating event network-changed:526f05d6-1296-44d3-9c91-fbbd7f009daf for instance 695b65de-524e-4a82-8bf9-30168c45edd5 on hv-cinder-84713 Aug 01 15:32:53.292356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-c7a53b73-b9c3-4eac-a233-ec2e6260e0b3 req-2da40a54-31cb-4f37-ac13-2802f05da019 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047415 Aug 01 15:32:53.293055 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 532/1034] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:32:53.603794 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:53.605032 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:53.613372 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:53.614442 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:53.615897 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:53.616778 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:54.008958 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:54.033132 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-a42e9fcb-c814-4bf5-b68f-fe43f78ca85c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1314 microversion: 2.1 time: 0.436346 Aug 01 15:32:54.035426 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 503/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:53 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:55.058731 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:55.059473 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:55.079002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:55.079536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:55.082438 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:55.084950 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:55.628836 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:55.643859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3b54c6f3-449d-4e50-9ff8-8e0933a4244a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1314 microversion: 2.1 time: 0.590182 Aug 01 15:32:55.644844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 533/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:55 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:56.669201 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:56.670651 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:56.681050 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:56.683219 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:56.684455 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:56.686961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:56.961009 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:56.970621 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1fd12164-5ab2-4104-9f32-1f6dcd97c4e6 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1314 microversion: 2.1 time: 0.306912 Aug 01 15:32:56.973107 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 504/1037] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:56 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:57.995356 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:57.995850 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:58.012057 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:58.012520 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:58.013334 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:58.013763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:58.425611 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:58.437101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14cb2c2c-e115-4002-90b6-bc69f53850b0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1314 microversion: 2.1 time: 0.446231 Aug 01 15:32:58.440378 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 534/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:57 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:32:59.464072 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:32:59.465536 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:32:59.474722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:59.475468 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:59.477193 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:32:59.478827 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:32:59.737384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:32:59.759914 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3ef9f6fd-9010-495b-adc6-fa38406896d3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1314 microversion: 2.1 time: 0.300927 Aug 01 15:32:59.760507 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 505/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:32:59 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:00.227127 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-5b9c53c3-451b-4bcc-ab24-c21cdc82d6cc req-8a08ce14-9490-4aab-8f66-12e7446f3882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695b65de-524e-4a82-8bf9-30168c45edd5", "name": "network-vif-plugged", "status": "completed", "tag": "526f05d6-1296-44d3-9c91-fbbd7f009daf"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:00.237991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:00.238980 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:00.250349 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5b9c53c3-451b-4bcc-ab24-c21cdc82d6cc req-8a08ce14-9490-4aab-8f66-12e7446f3882 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:00.251342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5b9c53c3-451b-4bcc-ab24-c21cdc82d6cc req-8a08ce14-9490-4aab-8f66-12e7446f3882 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:00.283901 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-5b9c53c3-451b-4bcc-ab24-c21cdc82d6cc req-8a08ce14-9490-4aab-8f66-12e7446f3882 service nova] Creating event network-vif-plugged:526f05d6-1296-44d3-9c91-fbbd7f009daf for instance 695b65de-524e-4a82-8bf9-30168c45edd5 on hv-cinder-84713 Aug 01 15:33:00.290238 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-5b9c53c3-451b-4bcc-ab24-c21cdc82d6cc req-8a08ce14-9490-4aab-8f66-12e7446f3882 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068312 Aug 01 15:33:00.291262 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 535/1040] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:00.780338 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:00.781071 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:00.783896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:00.790619 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:00.791066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:00.791840 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:00.792267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:01.103598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:01.113404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-ac15b61a-2454-4249-8a99-691944503f5d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1314 microversion: 2.1 time: 0.336705 Aug 01 15:33:01.125810 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 506/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:00 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:02.137762 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:02.139490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:02.146647 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:02.147481 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:02.148551 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:02.149385 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:02.305004 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:02.318601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0fd85adf-cda0-42b5-afff-bc7e4b9803df tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1498 microversion: 2.1 time: 0.185538 Aug 01 15:33:02.319592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 536/1042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:02 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:02.823619 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:02.824161 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:02.843328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:02.843843 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:02.844655 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:02.845094 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:02.881483 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:33:03.003641 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d521379-66b0-4b41-9657-e0d975e178f3 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "DELETE /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 204 len: 0 microversion: 2.1 time: 0.185116 Aug 01 15:33:03.005083 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 507/1043] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:33:02 2022] DELETE /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:33:03.017942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:03.019454 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:03.028952 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:03.029555 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:03.030616 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:03.031280 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:03.207841 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:03.220712 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea1a854e-aa8e-414a-86bf-98df8d3b9048 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1504 microversion: 2.1 time: 0.210957 Aug 01 15:33:03.221852 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 537/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:03 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:04.256353 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:04.261638 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:04.269901 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:04.270622 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:04.271399 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:04.271829 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:04.550499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:04.566966 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10ce44fd-df67-478e-a342-00e8152e16c0 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 200 len: 1504 microversion: 2.1 time: 0.313705 Aug 01 15:33:04.568215 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 508/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:04 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:05.044355 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-0a521ed3-5ccd-4e86-a7ed-cf16b9cf4760 req-adc6689d-e567-4bf2-a2b1-c51a92edbbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695b65de-524e-4a82-8bf9-30168c45edd5", "name": "network-vif-deleted", "tag": "526f05d6-1296-44d3-9c91-fbbd7f009daf"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:05.082577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0a521ed3-5ccd-4e86-a7ed-cf16b9cf4760 req-adc6689d-e567-4bf2-a2b1-c51a92edbbd1 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:05.083574 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0a521ed3-5ccd-4e86-a7ed-cf16b9cf4760 req-adc6689d-e567-4bf2-a2b1-c51a92edbbd1 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:05.104153 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-0a521ed3-5ccd-4e86-a7ed-cf16b9cf4760 req-adc6689d-e567-4bf2-a2b1-c51a92edbbd1 service nova] Creating event network-vif-deleted:526f05d6-1296-44d3-9c91-fbbd7f009daf for instance 695b65de-524e-4a82-8bf9-30168c45edd5 on hv-cinder-84713 Aug 01 15:33:05.110518 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-0a521ed3-5ccd-4e86-a7ed-cf16b9cf4760 req-adc6689d-e567-4bf2-a2b1-c51a92edbbd1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070033 Aug 01 15:33:05.111497 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 538/1046] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:05.589075 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:05.590539 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: 695b65de-524e-4a82-8bf9-30168c45edd5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:05.606038 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:05.606958 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:05.607836 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:05.608267 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:05.626719 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] HTTP exception thrown: Instance 695b65de-524e-4a82-8bf9-30168c45edd5 could not be found. Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Request method failure captured: Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 HTTP/1.1 Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_IemK5g0bZgwvVlBZZqZcnMZYyd5a9SRbMqW5P92dJPlY-_5DWHw-Gtqv5S96e9CJwAGEaum7f_ud-WXtj6bwcpJjETwRNmbAWjCxaLWPqX0qspHranwPNxNjaHxKjwIdQr2aInGktU-UfbVwKACQWT7us_L7a0TsHhEhkkoBJ-BwE Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 1947572d5cd646d08f4efaa2ef17e271 Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesActionsTest-1252703628 Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:33:05.628334 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1947572d5cd646d08f4efaa2ef17e271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1947572d5cd646d08f4efaa2ef17e271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1947572d5cd646d08f4efaa2ef17e271"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1947572d5cd646d08f4efaa2ef17e271"}]}] Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesActionsTest-1252703628 Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 1947572d5cd646d08f4efaa2ef17e271 Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesActionsTest-1252703628 Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesActionsTest-1252703628-project Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 9d3652448ec141918d94617077b9ce81 Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesActionsTest-1252703628-project Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 695b65de-524e-4a82-8bf9-30168c45edd5 could not be found. Aug 01 15:33:05.630273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '695b65de-524e-4a82-8bf9-30168c45edd5'} Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695b65de-524e-4a82-8bf9-30168c45edd5 could not be found. Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:05.631275 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695b65de-524e-4a82-8bf9-30168c45edd5 could not be found. Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695b65de-524e-4a82-8bf9-30168c45edd5 could not be found. Aug 01 15:33:05.632766 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:05.636780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Returning 404 to user: Instance 695b65de-524e-4a82-8bf9-30168c45edd5 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:05.636780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-76a58fe8-99b8-4234-9c23-e22216926f4d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5" status: 404 len: 111 microversion: 2.1 time: 0.046224 Aug 01 15:33:05.636780 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 509/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:05 2022] GET /compute/v2.1/servers/695b65de-524e-4a82-8bf9-30168c45edd5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:05.825145 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1122053231", "imageRef": "f85ae82f-36f8-4438-bb3e-f1a01b8ea368", "flavorRef": "452", "networks": [{"uuid": "140924ad-7b52-4113-a045-2cdbb49f30bf"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:05.907180 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] validate_networks() for [('140924ad-7b52-4113-a045-2cdbb49f30bf', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:33:06.334030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:33:06.335322 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:33:06.336164 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:33:06.336769 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:33:06.337172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:33:06.348601 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:06.349067 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:06.349845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:06.350432 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:06.372085 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Getting quotas for project 1947572d5cd646d08f4efaa2ef17e271. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:33:06.376089 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Getting quotas for user 9d3652448ec141918d94617077b9ce81 and project 1947572d5cd646d08f4efaa2ef17e271. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:33:06.387854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:33:06.390606 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f85ae82f-36f8-4438-bb3e-f1a01b8ea368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:33:06.440065 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0683af3-8844-491c-b9db-5e669c099001 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619369 Aug 01 15:33:06.441388 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 539/1048] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:33:06.452328 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7e8cbe5f-7c95-4335-9908-f0e731dd8abc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:06.453348 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7e8cbe5f-7c95-4335-9908-f0e731dd8abc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:06.853646 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-7e8cbe5f-7c95-4335-9908-f0e731dd8abc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:06.862924 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7e8cbe5f-7c95-4335-9908-f0e731dd8abc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1214 microversion: 2.1 time: 0.414265 Aug 01 15:33:06.865197 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 510/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:06 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1214 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:07.884565 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:07.885182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:07.894534 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:07.895379 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:07.896394 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:07.897172 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:07.991220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:08.000544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8363173f-0ad3-4231-8150-0add129c0b9e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1272 microversion: 2.1 time: 0.119745 Aug 01 15:33:08.002424 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 540/1050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:07 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:09.023208 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:09.024872 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:09.034740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:09.035540 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:09.036544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:09.037211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:09.161515 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-31338c0d-627d-4308-938d-05f2f6fe1a6b req-a1f29ec9-3414-455e-b07c-0bfe9d5cee93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5", "tag": "ccc18874-06c8-4f53-ab0f-b2092cefd40c"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:09.180919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-31338c0d-627d-4308-938d-05f2f6fe1a6b req-a1f29ec9-3414-455e-b07c-0bfe9d5cee93 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:09.181836 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-31338c0d-627d-4308-938d-05f2f6fe1a6b req-a1f29ec9-3414-455e-b07c-0bfe9d5cee93 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:09.198545 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-31338c0d-627d-4308-938d-05f2f6fe1a6b req-a1f29ec9-3414-455e-b07c-0bfe9d5cee93 service nova] Creating event network-changed:ccc18874-06c8-4f53-ab0f-b2092cefd40c for instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 on hv-cinder-84713 Aug 01 15:33:09.206626 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-31338c0d-627d-4308-938d-05f2f6fe1a6b req-a1f29ec9-3414-455e-b07c-0bfe9d5cee93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047971 Aug 01 15:33:09.207989 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 541/1051] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:33:09.322127 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:09.333296 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8f74490b-2709-4e68-8efd-67818841c374 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.314159 Aug 01 15:33:09.349305 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 511/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:09 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:10.358000 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:10.358850 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:10.366073 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:10.366525 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:10.367293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:10.367724 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:10.591985 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:10.603886 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3d0cf35c-5f1c-4d42-b472-3bda77cd4c4f tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.252619 Aug 01 15:33:10.604884 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 542/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:10 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:10.939549 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-f85aa573-7b02-472d-82e4-6de82380bfea tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Action: 'create', calling method: .version_select at 0x7f03676ab1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1430486364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5KXtUQ2PEcaES7YGIIjAheCxvvTsjT4QOHS8eefEYcghXojOpBM+NMrzi+vkXUk2NWsI8twnQm1Ezmpc2KFTZSvBmZMumVcyh/8p23jbTeD+B/RtNdcPiVk5t6KYxWPg=="}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:10.958371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-f85aa573-7b02-472d-82e4-6de82380bfea tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Getting quotas for project ff70f42c96804182af2e61e501ee8a21. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:33:10.962961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.quota [None req-f85aa573-7b02-472d-82e4-6de82380bfea tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Getting quotas for user 5f2b4bba3ed5400d8ab618a6ccbc04d4 and project ff70f42c96804182af2e61e501ee8a21. Resources: {'key_pairs'} {{(pid=117824) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:33:10.989187 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-f85aa573-7b02-472d-82e4-6de82380bfea tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054598 Aug 01 15:33:10.990003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 512/1054] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 15:33:10 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:11.105763 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-954667404", "imageRef": "ffe662be-7b3c-42a2-9658-029be400a2df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1430486364", "networks": [{"uuid": "669e31fa-5d2e-4cb3-915b-d333cc0dc643"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:11.159382 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] validate_networks() for [('669e31fa-5d2e-4cb3-915b-d333cc0dc643', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:33:11.534595 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:33:11.535125 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:33:11.535481 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:33:11.535919 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:33:11.536328 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:33:11.546468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:11.546913 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:11.547713 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:11.548141 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:11.558943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:11.567539 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Getting quotas for project ff70f42c96804182af2e61e501ee8a21. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:33:11.571769 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Getting quotas for user 5f2b4bba3ed5400d8ab618a6ccbc04d4 and project ff70f42c96804182af2e61e501ee8a21. Resources: {'instances', 'cores', 'ram'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:33:11.583220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:33:11.585437 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ffe662be-7b3c-42a2-9658-029be400a2df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:33:11.624189 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:11.624776 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:11.627026 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:11.631195 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38360420-2afd-427e-9091-33afea2d59f2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530220 Aug 01 15:33:11.632414 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 543/1055] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 15:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:33:11.633595 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:11.634064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:11.634824 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:11.635504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:11.641713 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:11.647568 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d80f1ff-0a35-4f65-b6ed-1d78e859ce5e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:11.648184 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d80f1ff-0a35-4f65-b6ed-1d78e859ce5e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:11.740178 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d80f1ff-0a35-4f65-b6ed-1d78e859ce5e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:11.749030 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d80f1ff-0a35-4f65-b6ed-1d78e859ce5e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1258 microversion: 2.1 time: 0.106466 Aug 01 15:33:11.749635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 544/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:11 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1258 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:11.831564 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:11.839642 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-d1d2689f-d987-48b2-ab9f-0221420fee1a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.219421 Aug 01 15:33:11.840213 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 513/1057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:11 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:12.771640 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:12.772259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:12.781766 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:12.782959 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:12.784135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:12.784930 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:12.790140 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=73 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:12.861122 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:12.866273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:12.867593 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:12.872891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13b05c1b-fe03-4b12-bdce-fc04b20599cf tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1316 microversion: 2.1 time: 0.105520 Aug 01 15:33:12.873490 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 545/1058] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:12 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:12.875889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:12.876415 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:12.877274 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:12.877945 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:13.085237 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:13.093554 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-42b9bced-8512-40c8-9baf-3deca256a8ba tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.234111 Aug 01 15:33:13.094536 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 514/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:12 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:13.894923 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:13.896194 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:13.905087 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:13.905791 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:13.906693 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:13.907205 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:14.080888 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:14.088745 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-493a67fd-c166-4749-8691-c9e8ddb54889 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.197736 Aug 01 15:33:14.089329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 546/1060] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:13 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:14.102776 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-36201134-f4e3-44e8-b7fe-71b0366717ce req-b169f48b-5a39-4d67-ad8d-e6feee66231a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5", "name": "network-vif-plugged", "status": "completed", "tag": "ccc18874-06c8-4f53-ab0f-b2092cefd40c"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:14.117993 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:14.119601 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-36201134-f4e3-44e8-b7fe-71b0366717ce req-b169f48b-5a39-4d67-ad8d-e6feee66231a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:14.121090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-36201134-f4e3-44e8-b7fe-71b0366717ce req-b169f48b-5a39-4d67-ad8d-e6feee66231a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:14.123015 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:14.133827 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-36201134-f4e3-44e8-b7fe-71b0366717ce req-b169f48b-5a39-4d67-ad8d-e6feee66231a service nova] Creating event network-vif-plugged:ccc18874-06c8-4f53-ab0f-b2092cefd40c for instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 on hv-cinder-84713 Aug 01 15:33:14.134877 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:14.135390 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:14.136236 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:14.136866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:14.140299 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-36201134-f4e3-44e8-b7fe-71b0366717ce req-b169f48b-5a39-4d67-ad8d-e6feee66231a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042111 Aug 01 15:33:14.141104 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 515/1061] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:14.331220 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:14.340359 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7e74234-0d0c-46d4-aeb7-3a7c3e7b5a47 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.229227 Aug 01 15:33:14.341652 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 547/1062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:14 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:15.111675 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:15.113075 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:15.120211 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:15.120697 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:15.121462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:15.121968 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:15.283182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:15.299219 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3e4f9fba-7274-4a2b-9fd8-f08555b7e771 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.191801 Aug 01 15:33:15.300322 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 516/1063] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:15 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:15.362288 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:15.363005 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:15.370912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:15.371754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:15.373018 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:15.373604 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:15.565550 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:15.578895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cb91ae1b-c146-4ead-91f4-a909b5db408d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.220102 Aug 01 15:33:15.579875 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 548/1064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:15 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:16.329115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:16.331728 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:16.341398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:16.341858 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:16.342689 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:16.343113 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:16.507691 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:16.515390 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-37802b35-9f10-4260-8f9d-767e2573698c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.197191 Aug 01 15:33:16.516691 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 517/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:16 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:16.602992 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:16.603645 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:16.610732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:16.611183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:16.611969 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:16.612399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:16.769827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:16.778575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bbef3b1a-c2c5-45df-bf1c-c81f942ac222 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.179597 Aug 01 15:33:16.779328 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 549/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:16 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:17.537985 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:17.539082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:17.546779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:17.547314 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:17.548120 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:17.548379 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:17.693178 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:17.702984 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-34af7b38-0998-461f-b003-9d383ed9ab5b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.169282 Aug 01 15:33:17.705493 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 518/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:17 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:17.805200 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:17.805734 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:17.812818 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:17.813270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:17.814354 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:17.814791 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:17.996993 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:18.007139 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5041205f-8070-4856-90a4-ce7bb7c5c74c tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.206065 Aug 01 15:33:18.007674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 550/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:17 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:18.725486 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:18.726881 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:18.735115 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:18.735949 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:18.736981 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:18.737651 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:18.906420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:18.914563 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8270a189-11c4-42f8-a690-51fc271c8f21 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.194196 Aug 01 15:33:18.917818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 519/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:18 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:19.035049 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:19.036025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:19.044996 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:19.045447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:19.046259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:19.046692 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:19.196431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:19.204614 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6539f1df-ab2e-4951-aec9-4b66fec04ee8 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.176590 Aug 01 15:33:19.205186 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 551/1070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:19 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:19.936885 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:19.937771 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:19.945182 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:19.945747 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:19.946615 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:19.947125 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:20.094765 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:20.112458 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-452dd586-7f47-4cad-b406-9e3a9f6340a0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.180402 Aug 01 15:33:20.113659 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 520/1071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:19 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:20.228426 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:20.228991 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:20.235954 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:20.236425 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:20.237219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:20.237653 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:20.389498 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:20.398007 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11ea2d26-75ee-4102-9ba3-2176c298a3bf tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.174373 Aug 01 15:33:20.398936 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 552/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:20 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:21.140154 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:21.140712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:21.142929 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=6 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:21.148815 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:21.149369 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:21.150166 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:21.150603 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:21.290688 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:21.299125 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-27ef9cdb-0a8f-4687-99e5-d52ff51437f7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.163284 Aug 01 15:33:21.299707 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 521/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:21 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:21.419108 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:21.419674 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:21.426845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:21.427293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:21.428079 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:21.428516 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:21.556050 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:21.574732 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:21.586330 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b9d7c2e-7d73-431f-be50-56061f0140b2 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.170768 Aug 01 15:33:21.587151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 553/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:21 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:22.320724 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:22.321426 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:22.328763 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:22.329363 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:22.330792 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:22.331402 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:22.612215 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:22.613336 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:22.615509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=14 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:22.623574 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:22.624357 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:22.625264 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:22.625866 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:22.632718 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:22.646386 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-241b614f-0140-4148-8915-e3ec423069b4 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.329446 Aug 01 15:33:22.647363 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 522/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:22 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:22.911011 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:22.919434 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad6cd8a7-85be-42a6-9a09-85fa9a4941ea tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.311432 Aug 01 15:33:22.920046 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 554/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:22 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:23.048351 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-a40f2fb8-e9ac-481b-9053-a4e980f46048 req-72431077-1673-4018-a24e-51a4b7726707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8777dc75-c886-41b8-b24b-957b13d966e2", "tag": "011169e2-363b-4f29-9009-8d37b2738bbd"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:23.068090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-a40f2fb8-e9ac-481b-9053-a4e980f46048 req-72431077-1673-4018-a24e-51a4b7726707 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:23.068090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-a40f2fb8-e9ac-481b-9053-a4e980f46048 req-72431077-1673-4018-a24e-51a4b7726707 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:23.088380 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-a40f2fb8-e9ac-481b-9053-a4e980f46048 req-72431077-1673-4018-a24e-51a4b7726707 service nova] Creating event network-changed:011169e2-363b-4f29-9009-8d37b2738bbd for instance 8777dc75-c886-41b8-b24b-957b13d966e2 on hv-cinder-84713 Aug 01 15:33:23.100144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-a40f2fb8-e9ac-481b-9053-a4e980f46048 req-72431077-1673-4018-a24e-51a4b7726707 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058389 Aug 01 15:33:23.103522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 523/1077] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:23.670138 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:23.670949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:23.678802 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:23.679269 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:23.680028 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:23.680574 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:23.894804 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:23.905512 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-449b9309-743d-4e08-8eae-d7f6e2397e3b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.240675 Aug 01 15:33:23.906244 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 555/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:23 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:23.941868 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:23.942439 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:23.949059 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:23.949499 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:23.950283 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:23.950715 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:24.186696 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:24.195222 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-8d3ae1d2-2786-46c8-ac56-5def8b062747 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1314 microversion: 2.1 time: 0.257681 Aug 01 15:33:24.201240 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 524/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:23 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:24.930696 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:24.931282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:24.938548 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:24.938998 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:24.939775 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:24.940209 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:25.086912 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:25.095041 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-123391d5-6a0e-49b9-a489-593ff58e9a05 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.168509 Aug 01 15:33:25.095636 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 556/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:24 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:25.217911 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:25.218481 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:25.225589 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:25.226086 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:25.226871 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:25.227303 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:25.377517 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:25.387130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4944b6f4-983f-4cf6-9d31-84a1d860b2dc tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1498 microversion: 2.1 time: 0.173610 Aug 01 15:33:25.387710 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 525/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:25 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:25.877497 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:25.878036 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:25.884942 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:25.885435 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:25.886266 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:25.886706 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:25.914688 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:33:26.002237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0c6fbd5b-fd3b-4f22-b92f-8c0f7dc46b8d tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 204 len: 0 microversion: 2.1 time: 0.128329 Aug 01 15:33:26.003154 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 557/1082] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:33:25 2022] DELETE /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:33:26.011685 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:26.012626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:26.019341 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:26.019793 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:26.020617 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:26.021047 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:26.116910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:26.117653 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:26.125091 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:26.125544 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:26.126376 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:26.127242 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:26.159906 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:26.168544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1143d621-4f34-4099-ae90-d5bcc37ed73e tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1504 microversion: 2.1 time: 0.160898 Aug 01 15:33:26.169332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 526/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:26 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:26.276754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:26.285610 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0707dd68-298a-4f9a-8f1a-ce013b6849e7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.173035 Aug 01 15:33:26.287058 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 558/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:26 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:27.192502 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:27.193317 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:27.202720 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:27.203624 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:27.204569 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:27.205343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:27.309360 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:27.310038 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:27.317130 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:27.317585 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:27.318370 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:27.318793 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:27.355035 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:27.362804 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-92992272-6b2c-4569-8ea2-8f107baa799b tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1504 microversion: 2.1 time: 0.175222 Aug 01 15:33:27.363384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 527/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:27 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:27.529759 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:27.539854 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-06b1c86e-9617-4714-95df-ef081d7df475 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.234394 Aug 01 15:33:27.540901 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 559/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:27 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:27.943803 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-019bfe6f-a3f6-47ce-b065-f998d1432ef6 req-4d57b23b-4d08-4706-b47d-85854e616d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5", "name": "network-vif-deleted", "tag": "ccc18874-06c8-4f53-ab0f-b2092cefd40c"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:27.956991 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-019bfe6f-a3f6-47ce-b065-f998d1432ef6 req-4d57b23b-4d08-4706-b47d-85854e616d18 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:27.957591 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-019bfe6f-a3f6-47ce-b065-f998d1432ef6 req-4d57b23b-4d08-4706-b47d-85854e616d18 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:27.972048 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-019bfe6f-a3f6-47ce-b065-f998d1432ef6 req-4d57b23b-4d08-4706-b47d-85854e616d18 service nova] Creating event network-vif-deleted:ccc18874-06c8-4f53-ab0f-b2092cefd40c for instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 on hv-cinder-84713 Aug 01 15:33:27.979544 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-019bfe6f-a3f6-47ce-b065-f998d1432ef6 req-4d57b23b-4d08-4706-b47d-85854e616d18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039413 Aug 01 15:33:27.980184 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 528/1087] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:33:28.116530 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-c6521138-61c6-41d9-ba2f-ff8be13b2a84 req-7156df7a-a647-47d5-91d8-2dd57016b36f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8777dc75-c886-41b8-b24b-957b13d966e2", "name": "network-vif-plugged", "status": "completed", "tag": "011169e2-363b-4f29-9009-8d37b2738bbd"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:28.126788 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c6521138-61c6-41d9-ba2f-ff8be13b2a84 req-7156df7a-a647-47d5-91d8-2dd57016b36f service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:28.127222 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c6521138-61c6-41d9-ba2f-ff8be13b2a84 req-7156df7a-a647-47d5-91d8-2dd57016b36f service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:28.130099 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:28.140664 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-c6521138-61c6-41d9-ba2f-ff8be13b2a84 req-7156df7a-a647-47d5-91d8-2dd57016b36f service nova] Creating event network-vif-plugged:011169e2-363b-4f29-9009-8d37b2738bbd for instance 8777dc75-c886-41b8-b24b-957b13d966e2 on hv-cinder-84713 Aug 01 15:33:28.145833 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-c6521138-61c6-41d9-ba2f-ff8be13b2a84 req-7156df7a-a647-47d5-91d8-2dd57016b36f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Aug 01 15:33:28.146441 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 560/1088] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:33:28.386357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:28.389119 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:28.395835 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:28.396371 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:28.397148 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:28.397579 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:28.437954 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:28.438447 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:28.438901 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.objects.instance [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lazy-loading 'fault' on Instance uuid c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 {{(pid=117824) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:33:28.499513 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3652448ec141918d94617077b9ce81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1947572d5cd646d08f4efaa2ef17e271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:28.507140 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-633b89b0-d189-455d-80a0-71b759885e88 tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 200 len: 1304 microversion: 2.1 time: 0.126209 Aug 01 15:33:28.507744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 529/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:28 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:28.564754 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:28.565475 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:28.572492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:28.572947 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:28.573740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:28.574183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:28.712156 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:28.720194 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c970b3b-9f6c-4ebe-9b60-9489ee8aa87c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.161097 Aug 01 15:33:28.720859 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 561/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:28 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:29.530857 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:29.531462 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] [instance: c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:29.540743 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:29.541148 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:29.542172 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:29.542863 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:29.561019 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] HTTP exception thrown: Instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 could not be found. Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Request method failure captured: Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 HTTP/1.1 Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_IemK5g0bZgwvVlBZZqZcnMZYyd5a9SRbMqW5P92dJPlY-_5DWHw-Gtqv5S96e9CJwAGEaum7f_ud-WXtj6bwcpJjETwRNmbAWjCxaLWPqX0qspHranwPNxNjaHxKjwIdQr2aInGktU-UfbVwKACQWT7us_L7a0TsHhEhkkoBJ-BwE Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 1947572d5cd646d08f4efaa2ef17e271 Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-VolumesActionsTest-1252703628 Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:33:29.562773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1947572d5cd646d08f4efaa2ef17e271"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1947572d5cd646d08f4efaa2ef17e271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1947572d5cd646d08f4efaa2ef17e271"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1947572d5cd646d08f4efaa2ef17e271"}]}] Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-VolumesActionsTest-1252703628 Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 1947572d5cd646d08f4efaa2ef17e271 Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-VolumesActionsTest-1252703628 Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-VolumesActionsTest-1252703628-project Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 9d3652448ec141918d94617077b9ce81 Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-VolumesActionsTest-1252703628-project Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 could not be found. Aug 01 15:33:29.564480 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5'} Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 could not be found. Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:29.565417 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 could not be found. Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 could not be found. Aug 01 15:33:29.567005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:29.568383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] Returning 404 to user: Instance c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:29.568383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-555b706f-ccc6-49ad-943b-04a052c22c5a tempest-VolumesActionsTest-1252703628 tempest-VolumesActionsTest-1252703628-project] 10.222.0.48 "GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5" status: 404 len: 111 microversion: 2.1 time: 0.037537 Aug 01 15:33:29.568383 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 530/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:29 2022] GET /compute/v2.1/servers/c3aaea82-dcb4-4c23-9b4a-a0c83f95c6c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:29.751507 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:29.752320 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:29.759996 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:29.760448 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:29.761259 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:29.761695 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:29.916424 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:29.927089 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-76f7b970-6775-4292-83db-c61667a496ef tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1358 microversion: 2.1 time: 0.178352 Aug 01 15:33:29.931935 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 562/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:29 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:30.948585 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:30.949231 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:30.957230 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:30.957698 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:30.958631 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:30.959076 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:31.100147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:31.109044 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-94b1b2d6-90b4-4d64-bf6a-4e748191a626 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1546 microversion: 2.1 time: 0.165279 Aug 01 15:33:31.109696 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 531/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:30 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:31.130851 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:31.131718 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:31.142778 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:31.143221 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:31.144395 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:31.144806 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:31.292225 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:31.301003 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2a71f2bd-2daf-49bf-9d91-626b0e08e7a2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1546 microversion: 2.1 time: 0.174365 Aug 01 15:33:31.301586 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 563/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:31 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:31.324349 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:31.329989 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:31.330741 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Searching by: {'deleted': False, 'project_id': 'ff70f42c96804182af2e61e501ee8a21'} {{(pid=117824) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 15:33:31.338134 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:31.338576 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:31.339367 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:31.339801 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:31.389003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=100 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:31.438098 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.multi_cell_list [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117824) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 15:33:31.541744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5a1301d5-7245-4dfd-bb63-b753d9500158 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.221243 Aug 01 15:33:31.542848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 532/1095] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Aug 1 15:33:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:31.555449 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:31.556282 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:31.564399 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:31.564847 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:31.565626 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:31.566088 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:31.710299 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:31.719183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4500e57d-c6f4-4570-abec-06adfc80280e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1546 microversion: 2.1 time: 0.168259 Aug 01 15:33:31.719801 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 564/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:31 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:32.411488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:32.412303 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:32.416721 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-5e808765-a4eb-4da7-9a35-646a417cc774 req-6e49a1a1-5fdc-4b20-a17b-c707b64d5c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5af3584c-8d03-48c9-9dba-be6afd6945f7", "tag": "68396f97-50f0-4f0c-a053-c52ece647f48"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:32.419163 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:32.419811 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:32.421194 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:32.421979 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:32.431149 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5e808765-a4eb-4da7-9a35-646a417cc774 req-6e49a1a1-5fdc-4b20-a17b-c707b64d5c80 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:32.431659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-5e808765-a4eb-4da7-9a35-646a417cc774 req-6e49a1a1-5fdc-4b20-a17b-c707b64d5c80 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:32.448295 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-5e808765-a4eb-4da7-9a35-646a417cc774 req-6e49a1a1-5fdc-4b20-a17b-c707b64d5c80 service nova] Creating event network-changed:68396f97-50f0-4f0c-a053-c52ece647f48 for instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 on hv-cinder-84713 Aug 01 15:33:32.451630 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:33:32.455743 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-5e808765-a4eb-4da7-9a35-646a417cc774 req-6e49a1a1-5fdc-4b20-a17b-c707b64d5c80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044459 Aug 01 15:33:32.462119 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 565/1097] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:32.560279 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0db6f255-e154-4a88-8a78-9b7bf7999fc5 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 204 len: 0 microversion: 2.1 time: 0.152690 Aug 01 15:33:32.566125 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 533/1098] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:33:32 2022] DELETE /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:33:32.571563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:32.572261 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:32.579389 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:32.579832 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:32.580594 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:32.581014 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:32.724529 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:32.732499 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d0cfbbea-65a1-4881-878e-7dbe151e3839 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1578 microversion: 2.1 time: 0.165151 Aug 01 15:33:32.733078 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 566/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:32 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:33.754987 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:33.755691 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:33.762941 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:33.763558 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:33.764848 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:33.765357 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:33.917169 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:33.931135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-0b19005b-52a7-415b-ae31-daae9fa8eb97 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1578 microversion: 2.1 time: 0.179625 Aug 01 15:33:33.932143 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 534/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:33 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:34.957659 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:34.958569 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:34.965487 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:34.966101 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:34.966994 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:34.967531 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:35.192080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:35.202592 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14a02da2-74cf-4bf9-860a-f2762e4b2a79 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1578 microversion: 2.1 time: 0.250068 Aug 01 15:33:35.203433 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 567/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:34 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1578 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:35.583530 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-5fba3569-53f4-44a3-b2ec-8e2f49371232 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b"}} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:35.588779 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-5fba3569-53f4-44a3-b2ec-8e2f49371232 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:35.603068 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fba3569-53f4-44a3-b2ec-8e2f49371232 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:35.604090 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fba3569-53f4-44a3-b2ec-8e2f49371232 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:35.605629 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fba3569-53f4-44a3-b2ec-8e2f49371232 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:35.606221 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-5fba3569-53f4-44a3-b2ec-8e2f49371232 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:35.964581 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-5fba3569-53f4-44a3-b2ec-8e2f49371232 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382828 Aug 01 15:33:35.969844 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 535/1102] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 15:33:35 2022] POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:36.248124 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-410b3992-ef38-4068-8376-8d0d6f4e34c5 req-2239f73e-d4fd-4e1b-9ee4-60fa694d499a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5af3584c-8d03-48c9-9dba-be6afd6945f7", "name": "network-vif-deleted", "tag": "68396f97-50f0-4f0c-a053-c52ece647f48"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:36.259896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:36.261212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:36.266175 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-410b3992-ef38-4068-8376-8d0d6f4e34c5 req-2239f73e-d4fd-4e1b-9ee4-60fa694d499a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:36.266968 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-410b3992-ef38-4068-8376-8d0d6f4e34c5 req-2239f73e-d4fd-4e1b-9ee4-60fa694d499a service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:36.270144 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:36.271712 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:36.272554 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:36.272998 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:36.287872 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-410b3992-ef38-4068-8376-8d0d6f4e34c5 req-2239f73e-d4fd-4e1b-9ee4-60fa694d499a service nova] Creating event network-vif-deleted:68396f97-50f0-4f0c-a053-c52ece647f48 for instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 on hv-cinder-84713 Aug 01 15:33:36.294472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-410b3992-ef38-4068-8376-8d0d6f4e34c5 req-2239f73e-d4fd-4e1b-9ee4-60fa694d499a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050081 Aug 01 15:33:36.296044 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 568/1103] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:36.363220 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:36.371272 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-825b0005-75c7-4a38-a699-29418bea3b61 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 200 len: 1226 microversion: 2.1 time: 0.119741 Aug 01 15:33:36.372212 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 536/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:36 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:37.394506 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:37.395293 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 5af3584c-8d03-48c9-9dba-be6afd6945f7] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:37.402895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:37.403270 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:37.404252 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:37.404792 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:37.421911 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] HTTP exception thrown: Instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 could not be found. Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Request method failure captured: Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 HTTP/1.1 Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_BV6ZqrsYBM03njtbd1zIqIZT8qUanRWK-0IGHT72ncl9bzVO6lAnn10sJkog-7jKURPByoyEpm-2D0I3kpdrj9Y_T5J-ldyDgNjnfxU__5LFBUqkU3cSpbS9ZkcKjmI9_tvYLDcoehlTuaQHGA_Dgss0MU209rx8vlWKHlrLI1_VQ Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:33:37.423563 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/97f413eea3b945cc843040b11d501993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_97f413eea3b945cc843040b11d501993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}] Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 0898fda8be3743f093dbb216f21eb931 Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 could not be found. Aug 01 15:33:37.425579 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '5af3584c-8d03-48c9-9dba-be6afd6945f7'} Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 could not be found. Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:37.426447 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 could not be found. Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 could not be found. Aug 01 15:33:37.427798 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:37.430233 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Returning 404 to user: Instance 5af3584c-8d03-48c9-9dba-be6afd6945f7 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:37.431138 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d438944f-ad4a-4833-ae0c-424e2b9812b7 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7" status: 404 len: 111 microversion: 2.1 time: 0.041768 Aug 01 15:33:37.431677 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 569/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:37 2022] GET /compute/v2.1/servers/5af3584c-8d03-48c9-9dba-be6afd6945f7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:40.846213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-20492497-4d19-46d7-9291-86c8d333b6ef req-2a383fe2-0971-40fc-8fbb-99d2dc0d888c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b501c28-26be-4cb3-a318-b04537a639b6", "tag": "843a5381-9438-4fea-9e56-3350e9f962c1"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:40.849682 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:40.851229 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:40.866177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:40.866177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:40.866177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:40.866744 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:40.868660 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-20492497-4d19-46d7-9291-86c8d333b6ef req-2a383fe2-0971-40fc-8fbb-99d2dc0d888c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:40.869233 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-20492497-4d19-46d7-9291-86c8d333b6ef req-2a383fe2-0971-40fc-8fbb-99d2dc0d888c service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:40.886574 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-20492497-4d19-46d7-9291-86c8d333b6ef req-2a383fe2-0971-40fc-8fbb-99d2dc0d888c service nova] Creating event network-changed:843a5381-9438-4fea-9e56-3350e9f962c1 for instance 8b501c28-26be-4cb3-a318-b04537a639b6 on hv-cinder-84713 Aug 01 15:33:40.893946 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-20492497-4d19-46d7-9291-86c8d333b6ef req-2a383fe2-0971-40fc-8fbb-99d2dc0d888c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052022 Aug 01 15:33:40.895097 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 570/1106] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:40.909553 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:33:41.066746 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-23198012-21e8-4098-8923-9d45596f6ad3 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 204 len: 0 microversion: 2.1 time: 0.224311 Aug 01 15:33:41.070604 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 537/1107] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:33:40 2022] DELETE /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:33:41.082484 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:41.084383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:41.095442 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:41.096181 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:41.097140 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:41.097750 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:41.256327 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:41.266541 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ccd1c9eb-dfb1-47dd-942b-921b1a391bc0 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1578 microversion: 2.1 time: 0.193976 Aug 01 15:33:41.278350 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 571/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:41 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1578 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:42.291100 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:42.291965 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:42.294937 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell0:SELECT=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:42.295777 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:42.302912 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:42.303943 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:42.305120 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:42.305818 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:42.551538 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:42.569343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-71d847a4-20b1-4685-b907-b92d346fa59e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1578 microversion: 2.1 time: 0.281945 Aug 01 15:33:42.570605 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 538/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:42 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1578 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:43.597395 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:43.599813 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:43.602874 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:33:43.615685 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:43.616131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:43.616982 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:43.617409 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:43.906868 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:43.907582 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:43.915337 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:43.915973 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:43.916961 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:43.917821 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:43.919600 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:43.933534 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-205be87b-1259-4dbe-abfc-031f20ce4344 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1578 microversion: 2.1 time: 0.340252 Aug 01 15:33:43.936329 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 572/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:43 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1578 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:44.545644 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-cd0aa134-45e5-4e93-966b-a25deeb2ab58 req-25df20b4-c48e-4943-9048-9b4f22d5d9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b501c28-26be-4cb3-a318-b04537a639b6", "name": "network-vif-deleted", "tag": "843a5381-9438-4fea-9e56-3350e9f962c1"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:44.567625 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cd0aa134-45e5-4e93-966b-a25deeb2ab58 req-25df20b4-c48e-4943-9048-9b4f22d5d9e7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:44.568521 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cd0aa134-45e5-4e93-966b-a25deeb2ab58 req-25df20b4-c48e-4943-9048-9b4f22d5d9e7 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:44.585228 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-cd0aa134-45e5-4e93-966b-a25deeb2ab58 req-25df20b4-c48e-4943-9048-9b4f22d5d9e7 service nova] Creating event network-vif-deleted:843a5381-9438-4fea-9e56-3350e9f962c1 for instance 8b501c28-26be-4cb3-a318-b04537a639b6 on hv-cinder-84713 Aug 01 15:33:44.590748 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-cd0aa134-45e5-4e93-966b-a25deeb2ab58 req-25df20b4-c48e-4943-9048-9b4f22d5d9e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050258 Aug 01 15:33:44.591773 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 573/1111] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:44.610177 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:44.642717 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c7da6d3e-1c7c-4794-a9ec-7cece963f190 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1592 microversion: 2.1 time: 0.739815 Aug 01 15:33:44.643441 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 539/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:43 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1592 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:33:44.960960 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:44.961723 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:44.984143 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:44.984809 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:44.985924 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:44.986438 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:45.067575 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:45.068389 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:45.068827 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lazy-loading 'fault' on Instance uuid 8b501c28-26be-4cb3-a318-b04537a639b6 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:33:45.123212 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0898fda8be3743f093dbb216f21eb931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f413eea3b945cc843040b11d501993', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:45.133325 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec5b05c2-374e-4b8a-830d-a0e9a5a15263 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 200 len: 1231 microversion: 2.1 time: 0.179637 Aug 01 15:33:45.134605 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 574/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:44 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 1231 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:33:46.156882 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:46.158465 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: 8b501c28-26be-4cb3-a318-b04537a639b6] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:46.166398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:46.167192 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:46.168229 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:46.168889 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:46.190625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] HTTP exception thrown: Instance 8b501c28-26be-4cb3-a318-b04537a639b6 could not be found. Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Request method failure captured: Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 HTTP/1.1 Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_BV6ZqrsYBM03njtbd1zIqIZT8qUanRWK-0IGHT72ncl9bzVO6lAnn10sJkog-7jKURPByoyEpm-2D0I3kpdrj9Y_T5J-ldyDgNjnfxU__5LFBUqkU3cSpbS9ZkcKjmI9_tvYLDcoehlTuaQHGA_Dgss0MU209rx8vlWKHlrLI1_VQ Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:33:46.193066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/97f413eea3b945cc843040b11d501993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_97f413eea3b945cc843040b11d501993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}] Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 0898fda8be3743f093dbb216f21eb931 Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance 8b501c28-26be-4cb3-a318-b04537a639b6 could not be found. Aug 01 15:33:46.195080 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': '8b501c28-26be-4cb3-a318-b04537a639b6'} Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b501c28-26be-4cb3-a318-b04537a639b6 could not be found. Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:46.196089 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b501c28-26be-4cb3-a318-b04537a639b6 could not be found. Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b501c28-26be-4cb3-a318-b04537a639b6 could not be found. Aug 01 15:33:46.198175 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.199758 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Returning 404 to user: Instance 8b501c28-26be-4cb3-a318-b04537a639b6 could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:46.199758 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-13739149-e882-4eca-afbf-5175aec1e70a tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6" status: 404 len: 111 microversion: 2.1 time: 0.045600 Aug 01 15:33:46.202488 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 540/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:46 2022] GET /compute/v2.1/servers/8b501c28-26be-4cb3-a318-b04537a639b6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:46.875577 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:46.876635 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:46.885425 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:46.885988 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:46.886853 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:46.887361 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:46.909095 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] HTTP exception thrown: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Request method failure captured: Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e HTTP/1.1 Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_BV6ZqrsYBM03njtbd1zIqIZT8qUanRWK-0IGHT72ncl9bzVO6lAnn10sJkog-7jKURPByoyEpm-2D0I3kpdrj9Y_T5J-ldyDgNjnfxU__5LFBUqkU3cSpbS9ZkcKjmI9_tvYLDcoehlTuaQHGA_Dgss0MU209rx8vlWKHlrLI1_VQ Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:33:46.912213 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/97f413eea3b945cc843040b11d501993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_97f413eea3b945cc843040b11d501993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}] Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 0898fda8be3743f093dbb216f21eb931 Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.914431 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': 'b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e'} Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:46.915628 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.917274 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.919951 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Returning 404 to user: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:46.920834 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-71d474b9-d67e-4016-9e2c-3c003847086e tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 404 len: 111 microversion: 2.1 time: 0.057324 Aug 01 15:33:46.921590 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 575/1115] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:33:46 2022] DELETE /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:33:46.932313 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:46.934050 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] [instance: b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:46.946746 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:46.947621 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:46.948709 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:46.949403 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:46.967680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.wsgi [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] HTTP exception thrown: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Request method failure captured: Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: request: GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e HTTP/1.1 Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept: application/json Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Accept-Encoding: identity Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Connection: close Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Length: 0 Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Content-Type: application/json Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Host: 10.222.0.48 Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Openstack-System-Scope: None Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: User-Agent: python-urllib3/1.26.10 Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Auth-Token: gAAAAABi5_BV6ZqrsYBM03njtbd1zIqIZT8qUanRWK-0IGHT72ncl9bzVO6lAnn10sJkog-7jKURPByoyEpm-2D0I3kpdrj9Y_T5J-ldyDgNjnfxU__5LFBUqkU3cSpbS9ZkcKjmI9_tvYLDcoehlTuaQHGA_Dgss0MU209rx8vlWKHlrLI1_VQ Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Id: None Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Domain-Name: None Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Identity-Status: Confirmed Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Is-Admin-Project: True Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Id: default Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Domain-Name: Default Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Project-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Role: reader,member Aug 01 15:33:46.969680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Roles: reader,member Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/97f413eea3b945cc843040b11d501993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_97f413eea3b945cc843040b11d501993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/97f413eea3b945cc843040b11d501993"}]}] Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Id: 97f413eea3b945cc843040b11d501993 Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-Tenant-Name: tempest-TestVolumeBootPattern-1951101654 Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Id: default Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Domain-Name: Default Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Id: 0898fda8be3743f093dbb216f21eb931 Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: X-User-Name: tempest-TestVolumeBootPattern-1951101654-project Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: method: > Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: exception: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.971273 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: action_args: {'id': 'b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e'} Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:33:46.972061 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. Aug 01 15:33:46.973332 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: ERROR nova.api.openstack.wsgi Aug 01 15:33:46.977680 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Returning 404 to user: Instance b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e could not be found. {{(pid=117824) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:33:46.978524 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-7730f244-f226-4822-901e-2b93bfa8735c tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e" status: 404 len: 111 microversion: 2.1 time: 0.051922 Aug 01 15:33:46.980082 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 541/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:46 2022] GET /compute/v2.1/servers/b972eb0b-3bb6-4273-80bd-c1d28cdf9c8e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:33:47.590976 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-2c220fec-7fab-4a25-89c7-18b459db08a2 req-6f61dbf4-8021-4593-b824-899158d4f3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8777dc75-c886-41b8-b24b-957b13d966e2", "tag": "011169e2-363b-4f29-9009-8d37b2738bbd"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:47.619948 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2c220fec-7fab-4a25-89c7-18b459db08a2 req-6f61dbf4-8021-4593-b824-899158d4f3e3 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:47.620812 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2c220fec-7fab-4a25-89c7-18b459db08a2 req-6f61dbf4-8021-4593-b824-899158d4f3e3 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:47.652107 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-2c220fec-7fab-4a25-89c7-18b459db08a2 req-6f61dbf4-8021-4593-b824-899158d4f3e3 service nova] Creating event network-changed:011169e2-363b-4f29-9009-8d37b2738bbd for instance 8777dc75-c886-41b8-b24b-957b13d966e2 on hv-cinder-84713 Aug 01 15:33:47.658938 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-2c220fec-7fab-4a25-89c7-18b459db08a2 req-6f61dbf4-8021-4593-b824-899158d4f3e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072867 Aug 01 15:33:47.660219 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 576/1117] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:33:48.702785 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-c7ee8d49-2911-402a-8f07-87e2794062a6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] Calling method '.version_select at 0x7f03675d3280>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:48.763927 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-c7ee8d49-2911-402a-8f07-87e2794062a6 tempest-TestVolumeBootPattern-1951101654 tempest-TestVolumeBootPattern-1951101654-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2087018318" status: 202 len: 0 microversion: 2.1 time: 0.065335 Aug 01 15:33:48.765908 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 542/1118] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Aug 1 15:33:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2087018318 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:33:49.823207 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-304988550"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:49.824922 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:49.840115 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:49.840900 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:49.842029 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:49.842663 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:50.219642 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.network.security_group_api [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Adding security group e30b67db-867c-4ff1-a5e7-3cd811d9852e to port 011169e2-363b-4f29-9009-8d37b2738bbd Aug 01 15:33:51.039265 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d68569d-9410-4506-9e3a-aa676cf4004d tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/action" status: 202 len: 0 microversion: 2.1 time: 1.223304 Aug 01 15:33:51.040818 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 577/1119] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:33:49 2022] POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/action => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:33:51.052740 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:33:51.054135 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:33:51.061595 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-6cb744ca-dc5b-4329-b699-9ecceb32c1d7 req-9ab6b1a5-d4b0-4e90-950d-b33dfc350856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8777dc75-c886-41b8-b24b-957b13d966e2", "tag": "011169e2-363b-4f29-9009-8d37b2738bbd"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:33:51.102027 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6cb744ca-dc5b-4329-b699-9ecceb32c1d7 req-9ab6b1a5-d4b0-4e90-950d-b33dfc350856 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:51.105372 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6cb744ca-dc5b-4329-b699-9ecceb32c1d7 req-9ab6b1a5-d4b0-4e90-950d-b33dfc350856 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:51.110856 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:51.115118 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:51.116614 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:33:51.118425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:33:51.140428 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-6cb744ca-dc5b-4329-b699-9ecceb32c1d7 req-9ab6b1a5-d4b0-4e90-950d-b33dfc350856 service nova] Creating event network-changed:011169e2-363b-4f29-9009-8d37b2738bbd for instance 8777dc75-c886-41b8-b24b-957b13d966e2 on hv-cinder-84713 Aug 01 15:33:51.158552 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-6cb744ca-dc5b-4329-b699-9ecceb32c1d7 req-9ab6b1a5-d4b0-4e90-950d-b33dfc350856 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100994 Aug 01 15:33:51.159536 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 578/1120] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:33:51.660463 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:33:51.684503 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-aaaefc38-9a75-48d0-8d01-72570fabb782 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1755 microversion: 2.1 time: 0.636981 Aug 01 15:33:51.688813 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 543/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:33:51 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1755 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:06.765099 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=15 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:06.765905 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=77 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:06.771132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf625a23-406f-477a-a0b7-08722e33ab19 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:06.773958 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf625a23-406f-477a-a0b7-08722e33ab19 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:06.784686 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf625a23-406f-477a-a0b7-08722e33ab19 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:06.785321 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf625a23-406f-477a-a0b7-08722e33ab19 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:06.786553 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf625a23-406f-477a-a0b7-08722e33ab19 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:06.787144 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf625a23-406f-477a-a0b7-08722e33ab19 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:06.876135 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf625a23-406f-477a-a0b7-08722e33ab19 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/action" status: 202 len: 0 microversion: 2.1 time: 0.112934 Aug 01 15:34:06.876808 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 579/1122] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:34:06 2022] POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:34:06.884865 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:06.885504 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:06.888012 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:06.888896 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:06.895461 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:06.895986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:06.896772 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:06.897466 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:07.144174 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:07.152694 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-10cca1b7-7e1c-4b9b-a043-d4f5e7816cb6 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1747 microversion: 2.1 time: 0.271636 Aug 01 15:34:07.153232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 544/1123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:06 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1747 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:08.175772 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:08.176371 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:08.183472 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:08.183910 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:08.184664 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:08.185118 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:08.359262 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:08.367937 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4833cd3a-7747-4ce2-b286-1434bac2ffa0 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.197024 Aug 01 15:34:08.368511 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 580/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:08 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:09.146343 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:34:09.147005 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Mon Aug 1 15:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:34:09.390026 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:09.390650 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:09.398259 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:09.398781 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:09.399722 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:09.400353 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:09.550123 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:09.559630 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-84eb526a-60a8-4a95-93e3-101a1822397a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.173662 Aug 01 15:34:09.560232 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 545/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:09 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:10.582804 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:10.583403 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:10.590438 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:10.590891 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:10.591664 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:10.592098 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:10.750897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:10.761303 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3618e365-dae3-479e-8ecf-314ba302fdc7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.182844 Aug 01 15:34:10.762013 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 581/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:10 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:11.784728 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:11.785319 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:11.792323 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:11.792773 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:11.793534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:11.794079 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:11.955309 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:11.969696 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-9266db8a-3e44-4e72-b61c-52f26b6d8a1f tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.188728 Aug 01 15:34:11.970537 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 546/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:11 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:13.005351 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:13.006132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:13.017077 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:13.017795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:13.018782 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:13.019269 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:13.182845 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:13.191750 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a82fdc9c-d843-4e7e-aa59-d0dad9df093b tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.192746 Aug 01 15:34:13.192318 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 582/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:12 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:14.214049 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:14.214923 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:14.221912 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:14.222352 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:14.223131 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:14.223819 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:14.385522 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:14.397193 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-4f82a237-5301-487f-9773-c7443a44f414 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.187213 Aug 01 15:34:14.397771 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 547/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:14 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:15.421251 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:15.421926 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:15.429410 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:15.429964 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:15.430844 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:15.431383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:15.590183 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:15.600616 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d3c89c61-a453-4263-8617-540ae40c9a68 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.184743 Aug 01 15:34:15.601505 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 583/1130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:15 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:16.623035 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:16.623682 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:16.634594 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:16.635404 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:16.639811 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:16.640588 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:16.810717 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:16.819425 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-945dc516-bb10-4b0d-95c9-e11fa7d7659e tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.200662 Aug 01 15:34:16.820011 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 548/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:16 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:17.842132 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:17.842712 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:17.850134 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:17.850584 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:17.851365 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:17.851795 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:18.004734 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:18.014007 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7534bb7-8c75-4f86-a6a4-84b4304c150a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1752 microversion: 2.1 time: 0.175858 Aug 01 15:34:18.014600 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 584/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:17 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:19.036895 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:19.037534 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:19.044535 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:19.044986 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:19.045767 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:19.046626 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:19.212066 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:19.221739 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-3feaa833-2890-458e-a913-97ea3e97ffb7 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1755 microversion: 2.1 time: 0.189666 Aug 01 15:34:19.222420 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 549/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:19 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:51.668675 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-304988550"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:51.669612 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:51.673150 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=12 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:51.673968 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:51.684107 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:51.684775 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:51.685729 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:51.686509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:51.858584 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.network.security_group_api [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Removing security group e30b67db-867c-4ff1-a5e7-3cd811d9852e from port 011169e2-363b-4f29-9009-8d37b2738bbd Aug 01 15:34:52.237611 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2eb0b84-d652-4ab0-940f-2d1c84dd5f48 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/action" status: 202 len: 0 microversion: 2.1 time: 0.576375 Aug 01 15:34:52.238581 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 585/1134] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 15:34:51 2022] POST /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:34:52.256172 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_api:SELECT=12 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:52.260340 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG dbcounter [-] [117824] Writing DB stats nova_cell1:SELECT=36 {{(pid=117824) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:34:52.536484 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-89c02ae6-b3e2-4321-9d03-b381f677ad0f req-363dd506-5459-47d0-8df1-5a2db0736df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8777dc75-c886-41b8-b24b-957b13d966e2", "tag": "011169e2-363b-4f29-9009-8d37b2738bbd"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:52.547160 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-89c02ae6-b3e2-4321-9d03-b381f677ad0f req-363dd506-5459-47d0-8df1-5a2db0736df0 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:52.547959 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-89c02ae6-b3e2-4321-9d03-b381f677ad0f req-363dd506-5459-47d0-8df1-5a2db0736df0 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:52.560000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-89c02ae6-b3e2-4321-9d03-b381f677ad0f req-363dd506-5459-47d0-8df1-5a2db0736df0 service nova] Creating event network-changed:011169e2-363b-4f29-9009-8d37b2738bbd for instance 8777dc75-c886-41b8-b24b-957b13d966e2 on hv-cinder-84713 Aug 01 15:34:52.567128 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-89c02ae6-b3e2-4321-9d03-b381f677ad0f req-363dd506-5459-47d0-8df1-5a2db0736df0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321206 Aug 01 15:34:52.568242 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 550/1135] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:54.143984 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:54.144899 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:54.156435 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.157762 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.159072 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.159953 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.296914 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lazy-loading 'services' on Instance uuid 8777dc75-c886-41b8-b24b-957b13d966e2 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:34:54.405740 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-276f255b-f332-4abf-af13-785123b1dcc2 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments/2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b" status: 202 len: 0 microversion: 2.1 time: 0.270189 Aug 01 15:34:54.406658 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 586/1136] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:34:54 2022] DELETE /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments/2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:34:54.418373 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b85b73d0-cc0a-45f4-a7db-6807c36c506a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:54.421228 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b85b73d0-cc0a-45f4-a7db-6807c36c506a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:54.434101 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b85b73d0-cc0a-45f4-a7db-6807c36c506a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.435060 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b85b73d0-cc0a-45f4-a7db-6807c36c506a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.436256 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b85b73d0-cc0a-45f4-a7db-6807c36c506a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.437024 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b85b73d0-cc0a-45f4-a7db-6807c36c506a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.497286 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b85b73d0-cc0a-45f4-a7db-6807c36c506a tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083888 Aug 01 15:34:54.498653 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 551/1137] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:34:54 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:54.606967 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-89c1f2d1-4372-4c5a-995c-cd14fc2b4773 req-c7c3a445-69f4-44b0-9906-b1975d0496a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8777dc75-c886-41b8-b24b-957b13d966e2", "tag": "011169e2-363b-4f29-9009-8d37b2738bbd"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:34:54.624582 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-89c1f2d1-4372-4c5a-995c-cd14fc2b4773 req-c7c3a445-69f4-44b0-9906-b1975d0496a4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:54.625342 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-89c1f2d1-4372-4c5a-995c-cd14fc2b4773 req-c7c3a445-69f4-44b0-9906-b1975d0496a4 service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:54.642719 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-89c1f2d1-4372-4c5a-995c-cd14fc2b4773 req-c7c3a445-69f4-44b0-9906-b1975d0496a4 service nova] Creating event network-changed:011169e2-363b-4f29-9009-8d37b2738bbd for instance 8777dc75-c886-41b8-b24b-957b13d966e2 on hv-cinder-84713 Aug 01 15:34:54.649897 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-89c1f2d1-4372-4c5a-995c-cd14fc2b4773 req-c7c3a445-69f4-44b0-9906-b1975d0496a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048804 Aug 01 15:34:54.650894 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 587/1138] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:34:55.513572 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-1283ffa3-2330-410b-9d36-2cfe563a8136 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:55.518064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-1283ffa3-2330-410b-9d36-2cfe563a8136 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:55.530632 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1283ffa3-2330-410b-9d36-2cfe563a8136 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:55.531398 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1283ffa3-2330-410b-9d36-2cfe563a8136 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:55.533217 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1283ffa3-2330-410b-9d36-2cfe563a8136 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:55.534036 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-1283ffa3-2330-410b-9d36-2cfe563a8136 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:55.588964 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-1283ffa3-2330-410b-9d36-2cfe563a8136 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079657 Aug 01 15:34:55.590039 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 552/1139] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 15:34:55 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:34:55.608890 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:55.610255 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:55.621906 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:55.623131 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:55.624684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:55.625665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:55.738545 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] HTTP exception thrown: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 is not attached to volume 2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Request method failure captured: Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments/2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b HTTP/1.1 Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_Ika1Xy6bX4iBHIIktks1KWOnBuvaL7ZeLvqNMV11xA36QeODOQEbwmqP_YXuxy2INjYvexVPDJCe_kxk5atCPm4nzvJCRpUf8XJ-enit2L-ek05YNqn5VotOAqA_Ttf4wCIWfW_IckT82tsUdLS7Rh4_p5kwQTajAbfsOi2tqY6R8 Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: ff70f42c96804182af2e61e501ee8a21 Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestMinimumBasicScenario-1636316495 Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:34:55.743237 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff70f42c96804182af2e61e501ee8a21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ff70f42c96804182af2e61e501ee8a21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ff70f42c96804182af2e61e501ee8a21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff70f42c96804182af2e61e501ee8a21"}]}] Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestMinimumBasicScenario-1636316495 Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: ff70f42c96804182af2e61e501ee8a21 Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1636316495 Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestMinimumBasicScenario-1636316495-project Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 5f2b4bba3ed5400d8ab618a6ccbc04d4 Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestMinimumBasicScenario-1636316495-project Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:34:55.746025 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 is not attached to volume 2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '8777dc75-c886-41b8-b24b-957b13d966e2', 'id': '2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b'} Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b. Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:34:55.747637 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 is not attached to volume 2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 is not attached to volume 2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:34:55.750367 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Returning 404 to user: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 is not attached to volume 2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:34:55.752440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-743eed16-aca5-4a3a-b1ba-f15ff4ca4ba9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments/2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b" status: 404 len: 154 microversion: 2.1 time: 0.144615 Aug 01 15:34:55.752440 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 588/1140] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 15:34:55 2022] DELETE /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2/os-volume_attachments/2f90bee8-fafe-48c1-aa4b-e5ef7334cb4b => generated 154 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:34:56.983759 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:56.984969 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:56.994647 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.995099 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:56.995900 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:56.996360 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:57.032339 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Going to try to terminate instance {{(pid=117824) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:34:57.138570 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-b6309d95-8276-463a-8d35-e885660461fd tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 204 len: 0 microversion: 2.1 time: 0.159840 Aug 01 15:34:57.139631 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 553/1141] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 15:34:56 2022] DELETE /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:34:57.153903 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:57.155182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:57.166509 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:57.167284 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:57.168643 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:57.169413 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:57.377105 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:57.391177 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-83594e21-4f67-4e44-802a-9017c532bf4c tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1552 microversion: 2.1 time: 0.243971 Aug 01 15:34:57.392080 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 589/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:57 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:58.427636 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:58.428620 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.compute.api [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117824) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:58.435443 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:58.436064 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:58.437003 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:58.437509 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:58.620255 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.policy [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117824) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:34:58.630416 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-6eb7d812-b8c0-4b09-add9-d5909c4940a9 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1552 microversion: 2.1 time: 0.208218 Aug 01 15:34:58.631578 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 554/1143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:58 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1552 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:34:59.662698 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:34:59.663611 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:34:59.673192 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:59.673714 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:34:59.674684 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:34:59.675182 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:00.020926 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [req-e15d5f81-cdb6-429c-9930-a5b3b5fafa89 req-e32f6aba-3a1b-4d86-9f3a-9672b58d543e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8777dc75-c886-41b8-b24b-957b13d966e2", "name": "network-vif-deleted", "tag": "011169e2-363b-4f29-9009-8d37b2738bbd"}]} {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:35:00.024002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f2b4bba3ed5400d8ab618a6ccbc04d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff70f42c96804182af2e61e501ee8a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:35:00.034147 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-e15d5f81-cdb6-429c-9930-a5b3b5fafa89 req-e32f6aba-3a1b-4d86-9f3a-9672b58d543e service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:00.034863 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG oslo_concurrency.lockutils [req-e15d5f81-cdb6-429c-9930-a5b3b5fafa89 req-e32f6aba-3a1b-4d86-9f3a-9672b58d543e service nova] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117824) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:00.038275 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fe485290-6427-45ec-b975-ffb6370841ff tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 200 len: 1552 microversion: 2.1 time: 0.381006 Aug 01 15:35:00.048939 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.compute.server_external_events [req-e15d5f81-cdb6-429c-9930-a5b3b5fafa89 req-e32f6aba-3a1b-4d86-9f3a-9672b58d543e service nova] Creating event network-vif-deleted:011169e2-363b-4f29-9009-8d37b2738bbd for instance 8777dc75-c886-41b8-b24b-957b13d966e2 on hv-cinder-84713 Aug 01 15:35:00.053837 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 590/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:34:59 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 1552 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:35:00.055625 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [req-e15d5f81-cdb6-429c-9930-a5b3b5fafa89 req-e32f6aba-3a1b-4d86-9f3a-9672b58d543e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039935 Aug 01 15:35:00.056384 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 555/1145] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 15:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:35:01.065002 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:01.065949 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] [instance: 8777dc75-c886-41b8-b24b-957b13d966e2] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:35:01.077134 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:01.077943 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:01.079299 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:35:01.080050 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Lock "2e398c06-d4e1-4334-b93c-f81bdcc1cfda" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:35:01.104725 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] HTTP exception thrown: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 could not be found. Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Request method failure captured: Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 HTTP/1.1 Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept: application/json Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Connection: close Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Length: 0 Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Content-Type: application/json Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Host: 10.222.0.48 Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.10 Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABi5_Ika1Xy6bX4iBHIIktks1KWOnBuvaL7ZeLvqNMV11xA36QeODOQEbwmqP_YXuxy2INjYvexVPDJCe_kxk5atCPm4nzvJCRpUf8XJ-enit2L-ek05YNqn5VotOAqA_Ttf4wCIWfW_IckT82tsUdLS7Rh4_p5kwQTajAbfsOi2tqY6R8 Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Id: ff70f42c96804182af2e61e501ee8a21 Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestMinimumBasicScenario-1636316495 Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Role: reader,member Aug 01 15:35:01.107665 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Roles: reader,member Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff70f42c96804182af2e61e501ee8a21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ff70f42c96804182af2e61e501ee8a21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ff70f42c96804182af2e61e501ee8a21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff70f42c96804182af2e61e501ee8a21"}]}] Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestMinimumBasicScenario-1636316495 Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Id: ff70f42c96804182af2e61e501ee8a21 Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1636316495 Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User: tempest-TestMinimumBasicScenario-1636316495-project Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Id: 5f2b4bba3ed5400d8ab618a6ccbc04d4 Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestMinimumBasicScenario-1636316495-project Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: method: > Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: exception: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 could not be found. Aug 01 15:35:01.109532 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: action_args: {'id': '8777dc75-c886-41b8-b24b-957b13d966e2'} Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 could not be found. Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:35:01.110829 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 could not be found. Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 could not be found. Aug 01 15:35:01.112468 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Aug 01 15:35:01.113896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Returning 404 to user: Instance 8777dc75-c886-41b8-b24b-957b13d966e2 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:35:01.113896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9b01c33f-f726-403b-9ae5-5eb253c571db tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2" status: 404 len: 111 microversion: 2.1 time: 0.048705 Aug 01 15:35:01.113896 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 591/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 15:35:01 2022] GET /compute/v2.1/servers/8777dc75-c886-41b8-b24b-957b13d966e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:35:01.121824 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: DEBUG nova.api.openstack.wsgi [None req-dfe3da44-f0f7-462f-9ffd-9ace09446487 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] Calling method '.version_select at 0x7f036c0d0af0>' {{(pid=117824) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:35:01.145130 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO nova.api.openstack.requestlog [None req-dfe3da44-f0f7-462f-9ffd-9ace09446487 tempest-TestMinimumBasicScenario-1636316495 tempest-TestMinimumBasicScenario-1636316495-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1430486364" status: 202 len: 0 microversion: 2.1 time: 0.027775 Aug 01 15:35:01.145639 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: [pid: 117824|app: 0|req: 556/1147] 10.222.0.48 () {58 vars in 1272 bytes} [Mon Aug 1 15:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1430486364 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:35:47.300741 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:35:47.301675 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Mon Aug 1 15:35:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:37:29.156598 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:37:29.157363 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Mon Aug 1 15:37:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:37:45.709492 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:37:45.710383 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Mon Aug 1 15:37:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:37:47.679127 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:37:47.680000 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Mon Aug 1 15:37:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:39:01.256460 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:39:01.257392 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Mon Aug 1 15:39:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:39:07.311151 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:39:07.311895 dv-cinder-847132-3-iscsi devstack@n-api.service[117825]: Mon Aug 1 15:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:40:39.874359 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:40:39.874960 dv-cinder-847132-3-iscsi devstack@n-api.service[117824]: Mon Aug 1 15:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!